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Chapter 1: Introduction 



1.1 Introduction 


Among the vast application* of the commits 

proecs* large umounts of data. The knowled^ !,h"? lt maj0r appllcation is to manage and 
to study of computer science. The oLw IhS^ Pf ? e u" ,,n8 ^ “ ,he filnd8nCT,a J 
should be to do the calculations efficiently and V/store ^ programmin « 

optimistic way. Some structures need to be ! 1 ^ J rctr,5VC <**** in 215 

data. Thus, the study of structuring the data (h<- t °. 5 , torc ’ or ** an,zc - 2 nd search through 
manipulate data is the heart of computer science. ** ( *** &tnicturc3) and al 8 onth ™ that 

In this chapter, we will discuss the importance of structuring the data and analvMs of 
algorithms As wc know, problems solved on digital computers 
progressively large and more complex. Such a situation involves the use of appS 
data organization and efficient storage representation. This introductory chaptered give 
you basic understanding of the term data structure and its importance in information 
systems. 


1.2 Data and Information 

Before starting the discussion on the data structure and its types, it would be better to 
understand what data is and how it is important for any decision making process. The 
term data has been derived from the word datum (means that is given). Data is plural of 
datum. The term data refers to the value or simply set of values that are raw and 
unorganized. Data may be simple, random, and useless until it is organized (so called 
processed). Data is valuable raw material which can be in different forms such as 
numbers, words, alphabets, etc. 

When data is processed i.e. organized, structured, and presented in a meaningful context 
so that it becomes useful for decision making and understanding, it becomes 
Information. In layman language, data and information are interchangeable terms, but 
technically, no conclusion can be drawn from data. Information play vital role in decision 
making which is obtained from data. So, indirectly data is an important entity for decision 

making. 



Scanned by CamScanner 





Data st ructure 

elt1toU fic dAP£roachWi^-7. ^ated as a data item. Whereas cl ass * s 

'"Irktmlhe same subject is informat,on which can he 

Sted torn the data ( sn,den ' oducts in different cities over a ti me 

gSgjaiBSSSd.— 

1.3 Data Structure memory in various logical ways. A data 

We can organize data into *e compute er , s menW ry so that it can be used 

structure is'a way of storing the , j Jy mat hematical model of organization of 

^ X ch“ with the choice of an Abstract Data Type (ADT) 

A wll designed da. sm,cmre aUows a varie^of options to be performed v„y 
efficiently (taking less time, less space, and a 


1.3.1 Classification of Data Structures 

Data structures can be classified in several ways. These classifications are: 

• Linear and Non-Linear Data Structures 

• Static and Dynamic Data Structures 

• Homogeneous and Non-Homogeneous Data Structures 


Linear and Non-Linear Data Structures 

Linear Data Structure: The elements in a linear data structure form a linear sequence. 
Example of the linear data structures are: Array, Linked list, Queue, Stack etc. 

Non-Linear Data Structure: The elements in a non-linear data structure do not form 
any linear sequence. For example, Tree and Graph. 
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Static and Dynamic Data Structures 

nre ,h “ «™y occupation i. 

titnc Example of the stnti \\t V \ a 8 *™ c * uro$ canuo * Increased or decreased at run 

thSii ""fS ® 6 8 mv Ar ««> The size of an array is declared at 
the conn tic time and this size cannot be changed during the run time. 

Knt?T^ S mcmr; ST °, Jote - I'M* whose memory occupation 

is not rtxc V J *' 1 ' . K l ' < |' kcn h y ,hc!ic data structures can be increased or decreased at 
tun time. Example ot the dynamic data structure is Linked List. The size of linked list 
can be changed during the run time. 


Other data structures like stack, queue, tree, and graph can be static or dynamic 
depending on. w bother these are implemented using an array or a linked list. 


Homogeneous and Non-Homogeneous Datn Structures 


Homogeneous Data Structure: Homogeneous data structures arc those in which data of 
same type can be stored. Example of the homogeneous data structure is an Array. 

Non-Homogeneous Data Structure: Non-Homogeneous data structures arc those in 
which data of different types can be stored. Example of the non-homogeneous data 
structure is linked list. 


Other datn structures tike stack, queue, tree, and graph can be homogeneous or non- 
homogeneous depending on, whether these arc implemented using an array or a linked 
list respectively, 

Note: There ore two ways of storing linear data structure into the computer's memory. In 
the first way, tho linear relationship between the elements of the structure is represented 
bv sequential memory locations. For example, arrays, as elements of an array arc stored 
in contimious/adjnecnt memory locations. In second way, the linear relationship between 
tho elements of the structure is’given by using pointers (addresses) c.g. linked list. 


1.4 Concept of Data Types 

A data type can be defined as set of values and set 
those values. For example, an integer data type in 
[-32768 to 32767] and set of operations +> 
classified into two broad categories: 


of operations which arc permissible on 
*C' language can have range of values 
-, '*•,/,% etc. Data types can be 


• Primitive Data Types 

• Abstract Data Types 


1.4.1 Primitive Data Types 

Primitive data types arc also known ns prcddined or the primitive data 

may be different for different hmgunges. For.example, n C g ^ ^ valuC9 are 
types for storing the integer values are ml, long, short ana 
float, double and long double. 
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5Sal»W“ 00 “*’ aD d operations «• *« da “ ’" 3 ™f ‘ 

dctaiU Of ‘“hovf nf=tbt^Ts work) is hidden tomt* 

4tac jr queue, tree etc. Trie stack is an abMnct 
•* er ' . j^-ct data type* 216 . "rformed on the suck without knowing ft* 

2 ^&^‘^ Ma,inked,i,, 
asa3° f "**- . f . 



■ in the following 

5 aiiu a iiiv «. e - 

to Implementation 

Da^succtiu^ are thought of as in main memory (RAM) and file organization as 
to auxiliary storage (disks) 

^ « Y 4 'V^L A - Oi_ 


• Data stnicturc are tnougm ui « m »<«*•■* } - -, 

to auxiliary storage (disks) 

6 Short Description of Various Data Structures 

f ».1 Arrav 


1.6.1 Array 


Array is a very simple kind of data structure. It is the linear collection of finite number of 
homogeneous data elements. If we consider an array A with n elements then elements o 
the array will be referred using index set consisting of 71 consecutive numbers i- c - 
notations'^. n ' dements of an anay A can be referred by using different 


A[l]>A[2],A[3],A[4],A[S],,' .4[ n j 

wc can also refer ,he dew* of an array using lhe sub5cript 

notation as: 

* °*' . (WhCTC 1,2 *M»...Vn are called subscripts) 



Here 

lj &' 


Pro? 

arra - 




A 1 

8> v 

elc 
wt 
a < 


p£ 

T 
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array is awed into the cotnpww* memory. ils elements occupy ihe consecutive 

««?f number of elemems ,n „ urrav is Inuuvu « s „ 

can be calculated by using a simple formula: ' • 1 


Siie o f Array A = uh~ lb + l 


Where lb is the tower index of the army and u 6 is the upper index of the array. 

Consider an example of one dimensional linear array s in which names of five students 
have been stored. This arra\ can be shown diagrammatically as: 


1 •""" 1 


K.ijcNh | 

N*mvn 

Sonia I 

1 

« 3 

4 5 


One Dimensional Array ■ S' having 5 Elelments 

Here, to reier the student named Rajesh. \vc have to use the array notation as S[3] or 
s 3 as it has been stored at the third location in the array. 


Programming languages also support multidimensional arrays. The detailed concepts of 
army will be discussed in chapter 2. 


1.6.2 Linked List 

A linked list refers to the linear collection of data elements in which linear order is not 
given by their physical placement in memory (as in case of array). In linked list, the data 
elements are managed by collection of nodes, where each node contains link or pointer 
which points to the next node in the list. The beginning of the linked list is maintained by 
a special pointer variable which contains the address ot the hrst node in the list. The link 
part of the last node contains a special value called Null, which shows the end of the list. 
The detailed concept of linked list will be discussed in chapter 3. 


Bogin 













Amit 



Jatin 



fiaiesn 


Naveen 


—► 

Sonia 

Nutf 


Representation of Data using Linked List 


.6.3 Stack v 

» -*k mme LIFO list (Last In First Out) is a linear 

tack which is also popular wttn ^ ddetio ( n are restricted at only one end 

Election of data ekments in which r i ^ ^ ^ ^ and Qnly itera at the top 

town as top. Every new item is jnse ^ of stack of dish plates in which 

in be removed from the stack. Con removed from the top of the 

ean plates are added at die top ottos tack. Plat s *e rem> stack . 

ack. The first plate put on the stack is the last plate to be remo 



: 
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1,6.5 Tree 


Merarchlca^relaUo^shin bctwMn^^^-r h * C * 1UHC< * t0 rc P rcscnt data elements having 

i JflMr data structures for ^nU /f / 1 , ar nd non ‘ ,,ncar data structures is that in 

E here “ a fix,!<1 neM «•«»«* but <« «« of non- 

linear data structure, each element can have many different next elements. 


A very common example is the ancestor tree as shown in 
successors of John. Her children are Ana and Jimmy 
Smith. Jimmy’s children are Harris and Allen and so on. 


next figure. This tree shows the 
Ana’s children arc Scman and 


John 



/\ AAA 


A Family Tree 


The trees will be discussed in detail in the chapter of trees. 


1.6.6 Graph 

Graph is a non-linear kind of data structure which is used to represent data having 
relationship among its elements which arc not necessarily hierarchical in nature. For 
example, a graph can be used to represent the road map of a state in which various cities 
are connected with each other by different roads. 



7 
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Zl *tenat exactly once in order to process it is kno^n - 

Accessing sacn C1 —~* 




■arching 


w-»7 a's-s- tji the data structure is knovn 
£-z ±e positjoo ct a «--- 

ZS searching, 

... „-*~ s it- some other operations which are less frequently 

tsmc opcrancra — - -—- w 

rfccred oe iccre data smxturts. 1 cese operations ^re. 

Ccmhmnz two cr mere lists into a single list i> mer ging - 

Dividing 2 single list into r-vo cr more lists is splitting operation. 


IstjIbz 

•futrmg 

:«pti 2g 

iortlarj 


?!?jf C?erffixs ^ te£feaiK ^ »i* the various da* structures in the subsequent 

T*T» 


Creating a duplicate copy ct a list is known as copy operation. 

nts in ascending descending order is known as 


Ananging the elements in as 
screnz 


1.8 Algorithm 



-—wi yi j 

characteristics: 

* that are required for the solution ot 

ifc. 
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• Process: An algorithm must perform certain operations on the input data which 
are necessary for the solution of the problem. 

• Output: An algorithm should produce certain output after processing the inputs. 

• Finiteness: An algorithm must terminate after executing certain finite number of 
steps. 

• Effectiveness: Every step of an algorithm should play a role in the solution to 
the problem. Also, each step must be unambiguous, feasible and definite. 

1.8.1 Importance of Algorithm Analysis 

There are two basic requirements to solve any particular problem. These are: 

• Data 

• Instructions to manipulate data i.e. Algorithm 

To efficiently process the data, we decide the suitable data structure. Once the data 
structure is decided, the concentration is given to the choice of algorithm. A problem can 
be solved in various ways using different algorithms. So. the choice of an efficient 
algorithm is of great importance, which can be made by considering the following 

factors: 

• Programming requirements of an algorithm 

• Time requirement of an algorithm 

• Space requirement of an algorithm 



Programming Requirements of an Algorithm 


the programming features of the language. 


Space Requirements of an Algorithm 

To execute anv orocram. space is needed for various reasons: 



do not change during run time. 
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■^■^"TrtientS 8,1 r *jme to execute. The study for th e ti 

*»**n -. •**£££>«"* 


Each algcd*?J^ridu® iS m °^L, in advance, the time required to execute 
ta ..^ofan & —to know in ^ h . limits or not. 015 


* g nt solutions for a particular problem each win, 

can be several choose the most opttmal solution. 

' ISntdme requirement, one irem< . nts for any algorithm as it depends 

algori,hm is 10 bc ori,hra fe " f 

Sin^”i«bf ,h ' a,80rithro '. j:ff er e„t machines may be different so, we mainly 
Because the processor speed m*** (inK of an algorithm .rrespective , he 
concennate to estimate tn 

processor/machine 


. 0 rnmDlexity of an algorithm 

1.9 Comp y requirement of the algorithm. If time and space 

Complexity is the time ana spa ^ complexity of the algorithm is more and if 
requirement of the al * on “ ™ hc a i g0 ’rithm in less, complexity of that algorithm is less. 


time'and space requirement of die algorithm 

.._ on j Cnace the space requirement of the algorithm is not a 

Out of the two jt is avail ’ ab |e at very low cost. Only the time requirement 

oKgSm is considered an important factor to find the complexity. Because of the 
importance of time in finding the complexity, it is somettmes termed as time complexity. 


As the time requirement of the algorithm is dependent upon the input size irrespective of 
the other factors like machine/processor, time complexity is measured in terms of input 
sizen. If the input size to the algorithm is more, the complexity will be more and if the 
input size to the algorithm is less, the complexity will be less. 


For example, consider an algorithm which sorts an array of size 2000, will definitely take 
more time than to sort an array of size 20. Thus, we express the time complexity in terms 
of input sizen. 


th^mimL? 1 ^If 6 the ^ com P lexit y °f an algorithm, the basic approach is to count 
operation that°is eTernfL ^ °P era ^ on ,s executed. Here, the key operation is the major 
searching algorithm the key^onemt'— ber ° ftimes in ^ al 8°rithm. For example, in a 
count the key operation becanc P 10I V S com P ar ison between the elements. We only 
key operation. The time comnlexitv ? ° f the time taken ^ the algorithm is consumed by 
in that algorithm. ™ s ex P resse d as a function of key operation performed 


be divided into three types: S ^ e P en( fent upon the input size, still complexity can 


10 
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• Worst case complexity 

• Best case complexity 

• Average case complexity 

For a particular input, the result can be obtained in minimum time or maximum time or 
gverage time. For instance, consider the linear search (detail of linear search is in the 
chapter of Array) in which we find the desired element by comparing it with all the 
dements of the list (say n number of elements in the list) starting from the first element 
of the list 

If we get the desired element at first position then number of comparisons will be 1. So, 
complexity is 1. If we get the desired element at the last position then n umb er of 
comparisons will be n so complexity is it. 

If we get the desired element at any other position then the complexity will be between 
landn. So, the complexity can be different (maximum, minimum, or average) for a 
particular problem. Let us define the types of complexities. 

Worst Case Complexity: If the running time of the algorithm is longest for all the inputs 
then the complexity is called worst case complexity In this type of complexity, the key 
operation is executed maximum number of times. Worst case is the upper bound of 
complexity and in certain application domains e g. air traffic control, medical surgery, the 
wont case complexity is of crucial high importance. 

Best Case Complexity: If the running time of the algorithm is shortest for all die inputs 
then the complexity is called best case complexity . In this type of complexity, the key 
operation is executed minimum number of times 

Average Caae Complexity: If the running time of the algorithm falls between the worn 
case and the best case then the complexity is called average case complexity. Average 
case complexity of an algorithm is difficult to find To calculate the average case 
complexity of an algorithm, we have to take some assumptions. 

1.10 Asymptotic Analysis and Notations 

Complexity can be defined as the rate at which the storage or time requirement grows as 
a function of the problem size. The absolute growth depends on the machine used to 
execute the program, the compiler used to construct the program, and many other factors. 
We would like to twve a way of describing the inherent complexity of a program (or 
piece of a program), independent of machine/compiler considerations. This means that 
we must not try to describe the absolute tune or storage needed. We must instead 
concentrate on a proportionality approach, expressing the complexity in terms of its 
relationship to some known function. 

The type of analysis known as asymptotic analysis is wed to simplify the analysis of 

naming time by removing the details which may hf dfected by hardware or 

*ed. So, the god of asymptotic analysis is la ^ which may be affected by 



n 
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. K g 0 Notation 
. B ig Omega(0 Notation 
. Big Theta(9) Notation 

. Little Omega Notation 

• Little Theta Notation 

Ail the above notations are oserl to express the complexity of the algorithm. Let us deOne 
all the notations one by one. 

1.10.1 Big 0 Notation 

Big 0 notation is upper bound asymptotic notation. This means, a function f{x) is 
Big 0 of function g{x) and there exists the positive constants c and n 0 such that 


c.g(n)Zf(ri) for all n £ n 0 

Here, f{x) and g{x) are the functions of non-negative integers. 


Running 

Time 


n 



f(n) 
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25 

I” 

& 

10 


0 

12 3 4 5 

-> n 

Complexity = 0(ff(n)) = 0(n ) 

In general, Big O notation drops all the constant and lower order terms. 

For example, 5n Iog 2 n is 0(n log 2 n) 

5n — 3 is 0(n ) 

n 2 log 2 n + n 2 + 8n is 0(n 2 log 2 n) 

Even 5n - 3 is 0(n 3 ) but always an approximate as small as possible order of the 
function is taken. 

The complexity of any algorithm may be. 

Logarithmic expressed as 0(log 2 n) 

Linear expressed as 0(n) 

Quadratic expresses as 0(n 2 ) 

Polynomial expressed as 0(n k ) k > 1 

Exponential expressed as 0(a n ) a > 1 

1.10.2 Big Omega Notation 

Big Omega is asymptotically lower bound notation. This means a function / (x) is Big 
Omega of function g(x) and there exists two positive constants c and n 0 such that 

c.g(n) < f(n) foralln^n 0 

Here, f(x) and g(x) are the functions of non-negative integers. 




Scanned by CamScanner 






















HlgOmtt* nol*H«r» * c 0( n ) 

, h , beit c«s« running time or the lower bounds of the 
Wl On** «».T 1 '".[XitHon *(») i> only * lower bound on /(n). 

,i 3n+2 J3n V nil 

+ 7 I. fl(n) .. 100 n + 7 2 100n Vn21 

loon' + 3n + 2 l.fl(n J ) •" lOOn 1 + 3n + 2 a n ! V n s 1 

In f 2 Is 0(1) m 3n + 2 2: 1 V n 2; 1 but wc never take 

/i(l) , instead wc take nearest function, so 

n(n) 


1.10.1 lll« Them Notation 

dig ihfi# i« asymptotically a tight bound notation. This means a function f(x) is Big 
lh#ta of film lion //(.r) mul there exists three positive constants c x , c 2 and n„ such that 


c t ff(n)s;/(n) 5 c v g(n) for all n 2> n 0 

H«t, f{x) and //(x) are the functions of non-negative integers. 
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For example. 


3 n + 2 is 9(n) 


2 n is o(n 2 ) 

2n 2 is not o(n 2 ) 


is w(n) 



as 3n + 2 S 3n V n £ 2 and 3n + 2 ^ 4n V n £ 2 
Here, c t = 3, c 2 = 4 and n 0 = 2 
I00n 2 + 3n + 2 is 0(n 2 ) as 100n 2 + 3n + 2 £ n 2 V n 2: 5 and 

100n 2 + 3n + 2 £ 101n 2 V n > 5 
Here, c* = 1 , c 2 = 101 and n 0 = 5 

Theta notation is more precise as compared to Big O and Big Omega notation. 

1.10.4 Little o Notation 

A function fix) is little o of function g(x) and for every c there exists n 0 such that 
/(n) £ c.g(n) for all n £ n 0 

Little o is usually used to compare running times of the algorithms. If /(n) = 0 ( 5 ( 71 )) 
then it can be said that g(n) dominates f(n). 

For example, 



as 2n <1 n 2 V n £ 2 and c £ 1 

as 2n 2 is not <> n 2 for any positive n and 


1.10.5 Little omega (co) Notation 

A function f(x ) is little omega of function g(x) and for every c there exists n 0 such that 
c.g(n) S /(7i) for all n £ n 0 

For example, 


• ^ 


as ” 2 2: n 2 V n £ 2 and V c £ 1 
2 


2 

- 2 is not ro(n 2 ) as f not £ n for any positive vaue of n and c 
In the nutshell, iff and g are real numbers then, 

/(n) = 0 ( 0 (n)) ~ f £9 
f{n) = fl( 0 (n)) ~ f^g 
fin) = 0(gin)) ~ f = g 
fin) = 0 ( 0 ( 71 )) ~ f <9 
fin) = 07 ( 0 ( 71 ))« />0 
In actual, /(n) = 0 ( 0 ( 71 )) means that 
fin) e 0(0(7i)) 


; 
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^^ 7 ^^of Complexity with Input Si 2t 
1.11 Rate o jnc as thc j of inpu( 

4 mentioned, the complexity is w hat that we want to examine i f 

f„U«. This rate of wt ,f^ 0 me standard taction. These standard fu„ clio “ 

KComplishedbycomparmgA^,, 

arelofl,". n. n 0 2 ' . „ as an exponent is known as exponential fitnetion. Ttle 

The function like^ 2 ra o 8^^ aJ polynomial tactions. The fiinctions l 0fl . n 

functions ,B “ " ’ |ogorithm ic functions. Rate of growth of some standard function* 

nlog 2 n are known m 

is given in the table below. ____ _ _ 


16 


16 


32 


32 


64 


160 


256 


1024 


4096 


32768 


64 


64 


384 


4096 


262144 


128 


128 


896 


16384 


2097152 


256 


256 


2048 


262144 


67108864 


Rate of growth of some standard funcHons with the size of input 

increases most slowly and cubic 
compared to other functions such ^V** 501 ! 611 ^ ^ xnct i° n 2 n increases most rapidly as 
compare /(n) with these standirH fi 0garithmic ’ linear, quadratic, or cubic ftinctions. To 
pities of the algoVftm^e " C "° nS !" »* Bi « 0 notation to express thc 
g re shown below: of 8«wth of standard functions is plotted in the 
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o 1234567 89 10 

Input Siz«(n) 

Rate of growth of complexity with Input size 

The complexity of some popular algorithms is given below (in terms of Big O Notation) 
in the table below: 


Algorithm 

Complexity 

Linear Search 

0(n) 

Binary Search 

0(log 2 n ) 

Bubble Sort 

0(n 2 ) 

Quick Sort 

0(n login ) 

Insertion Sort 

0(n 2 ) 

Selection Sort 

0(n 2 ) 

Merge Sort 

0(n log 2 n) 

Heap Sort 

0(n log 2 n ) 



Complex!ties of some sorting and searching algorithms 
The derivation of complexities will he explained later dong with their respective 

algorithm. 
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ASj2£iamong Algorithms 

i 1 2 Time Sp ace h . define d as the function which gives the ti m . 

. exi „ of an in < erros ° f inp “‘ ^ ^ best _ al eorithm ^ 

TbecoW Swnts of *» a, f „ luires minimum time to execute it by takim, 

ssssrtfists^ bui ' prac,icai,y bo,h ,hese oh ^*t 

» cbitvc SimUlU ‘ n “^ y be various different solutions for a particular pro bi eia 
AS mentioned earlier, the" may time bu , less space and another may require l e; , 
toe such solution WjJ * e choose an algorithm according to our require^ 
time but more space. TTicrefor , int u we want to execute the program in |. SJ 

and constraints. If we have urn ^ which takes less time but it may take more 

time then we have to choose £ lications , we need to choose an algonthm that 
space. For example, m ute ^ ^ Qthcr hand? if wc have space constraint them* 
takes less time fonts^execu ^^ , cg3 gpacc but it may take more execution time. 
h$ v c to choose flu 5 

'.A 2_. *. Ktit mnra nx/vil 


have to choose an 

v M fasm the two options, one with less time but more space another with 
SSTiCiS nTs\ , wh... popularly known as Time Space trade-off amor j 

algorithms. 


aiguiiumu. 

Because of advancement in hardware technology and decreased cost of hardware, space 
is no longer a constraint. So, we can opt for algorithms with less execution time at the 

cost of storage space. 


1. 


2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 


What 

divide 


What, 

Write 

Dcscr 

What 

What 

What 

What 

Whal 


10. Wha' 
typei 

11. Wha 
Expl 


(Questlor 
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Introduction 


Exercise 

I* Wk®* ** d®*® structure? Explain the categories m which data structures can be 
divided. 

2. What are die factors which influence the choice of a particular data structure? 

3 . Write down the description of various kinds of data structures. 

4. Describe the various operations that can be perf orm ed on a data structure. 

5 . What is an algorithm? Write down the characteristics of an algorithm. 

6 . What do you mean by time-space trade-off among algorithms? 

7 . What is big O notation? What is its significance? 

8 . What is a data type? Briefly explain the various data types 

9. What is the difference between the data structure and file organization 0 

10. What do you mean by abstract data type 0 How it is different from primitive data 
types? 

11. What are various notations used to express the complexity of an algorithm? 
Explain. 

(Qaiatlon tnm various Universities previous Examlaatlons) 


1. Whit do you mean by complexity of an algorithm 0 Explain different types of 
complexities. 

2. In finding out the complexity of an algorithm, explain the time-space trade-off 

3. Explain the complexity of an algorithm by taking an example. 

4. Define Data Structure. List common operations which can be performed on data 
structures. Discuss the complexity of ®n algorithm. Discuss in brief the time-space 

trade-off. 


5 . 

6 . 

7 . 

9 . 


Give two examples of each Knew and non-linear data structures Abo give two 
applications for each example given by you. 

What do you mean by data organization? What are the different ways m which data 
can be organized? What are various operations which can be applied to any data 

structure? 



algorithm? Explain with suitable 


What do you understand by complexity of 
examples. 

What is the order of compteOl^ ^MfoOPlIgi 
a. Binary search 
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i c^ iu3dvsnB8es ' 

t * finC ,hc foll oW,n ®!„, res . 


prfine a0T? following 5 ' 

b ' Bi8° l "’ 0OU01 tv 

c - r!S* *■»'£* 

Space con'P lcWty 

_U/rit 


sp*^ w • 

cfinc algorithm- 


xity 

txity ,u to find the maximum element 

Write an alg° nth 


of an array. 


M „ W p..cb.>«Q« s, " , " ,) 


. for the efficiency of an algorithm are 

.TwomainiMasure 

A processor and memory 

B. Complexity and capacity 

C. Time and space 

D. Data and space 


Which of the following date .m*tur. in no. linear data structure? 

A. Arrays 

B. Linked lists 

C. Both of above 

D. None of above 


3. The time factor when determining the efficiency of algorithm is measured by 

A. Counting microseconds 

B. Counting the number of key operations 

C. Counting the number of statements 

D. Counting the kilobytes of algorithm 


4. The space factor when determining the efficiency of algorithm is measured by 
A. Counting the maximum memory needed by the algorithm 

C Count!!!!!!», minimum mcmor y needed by the algorithm 

D c mZtT**' mmory n " d ' d *>y ie algorithm 

8 ^ maximum duk apace needed by the algorithm 

|M I t : ' ' ' 


5 Which of the folio 
A Best case 

B, Worn 

C. Av, 


ist in complexity theory? 



D. Null ca 


6. The compf 

A. Much 

B. Much 

C. Somet 

D. None 


7. Which of 

A. Tree 

B. Grap 

C. Arra 

D. Non 


g. Which c 

A. Stri 

B. List 

C. Qu< 

D. All 


9. Match 

a. Co 

b. Tit 

c. Sf 


A. 

B. 

C. 

D. 


10. Th 
A. 


B. 

C. 

D 
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Introduction 

0 . Null Case 

cv Vhe cwnplexity of the Avenge ewe of an algorithm is 

A. Much more complicated to analyze than that of worst case 

B. Much more simpler to analyze than that of worst case 

f' Sometimes more complicated and some other times simpler than that of worst case 
\>. None of above 

\ Which of the following data structure is linear data structure? 

A. Tree 

B. Graph 

C. Army 

D. None of above 


g, Which of the following data structure is linear type? 

A. Strings 

B. Lists 

C. Queues 

D. AH of above 


o. Match the following, 
a. Completeness 
h Time Complexity 
c. Space Complexity 


A. a-iii. b-ii. c«i 

B. a-i. b-ii. c-iii 

C. a-iii. b-i, c-ii 

D. a-i. b-iii, c-ii 


i) How long does it take to find a solution 
in How much memory need to perform the search, 
in'lls the strategy guaranteed to find the 
solution when there in one. 


10. The number of comparisons done by sequential search is 



B. 

C. 

D. 


.v+i 



21 



) 

* 
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Chapter 2: Array 


2.1 Introduction 

In this chapter, we will discuss about the most commonly used linear data structure which 
is popularly known as an array. An array is the basic data structure which can he used as 
building block for many other complex data structures. Almost each complex data 
structure can be implemented using array. We will start explaining one dimensional 
array, various operations associated with array and then multidimensional array 

The concentration will be given to discussion about techniques for storage of (me and 
multidimensional array into the memory using row-major and column-major order At the 
end of the chapter, we will discuss about some special types of array and their memory 
representation. 

2.2 One Dimensional Array 

An array is the linear collection of finite number of homogeneous data elements Here, 
the term linear means the relationship of adjacency among the elements i.e 1st, 2nd, 

3rd . ,nth element of any array can be identified in sequence. The elements of an 

array are homogeneous which means, all the elements should be of same data type. 

When an array is stored into computer’s memory, its elements gets stored in consecutive 
memory locations. The elements of the array are referenced with an index wt wn»i»t. n| ( 
of consecutive numbers. The arrays are also popular with the name Vectors, and Tables 

in mathematics. 

Consider an array S which stores the mutual 

i oo< ♦«. iftfii index set of the array S consists of the integers • * 


e length of the array. Here, in 
to calculated using following 


The number of elements in an array is c< 
the above example, the size of the array 
simple formula: 

lb +1 


Slit of an array « ub 
Where ub is the upper Soda 
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Aooroe 
In the *h° ve , , 20 02 - >” S + 1 

Tbe ,i»of*“ n * ) ' - . . - 8 


The size of the «n./ l-8 

* 7 u index set consists of integers 1, 2, 3 

t +*m K -trrSSk -i *• —** 18 ^ ^ 

rr “ 0 , 1 ^ —»■ - 1995 - 1996 ' 1997 ' 1998 ' 1999 ** 

In our example* 

2001, and 2002 referred by using any of the following notations 

The elements of an array S can 

<• Co Slow* S 2000< $2001* ^2002 UR 

W W w , SP9991. S[2000], S(2001]. S[2002, 0 * 

; f ( L wantt0 refe r the wcond element of the ensy S <h«n the notsfon fo, this e, emm 
willl»S 1M .orS[1996]orS(1996) 

a 1 . a Wms*rir\t mitside the index set cannot be used as t valid subsenot 

ESE3U.*® “ d 19,4 »•«**(*« ° f index «' Thut 2m w 

1994 can not be used as valid subscript 

2 j Memory Representation of One Dimensional Array 

As mentioned earlier, the elements of an array are stored in consecutive memory 
locations. Thus, there is no need to keep track of address of etch element of an array 
This is the main advantage of array that allows us to refer any element directly by 
calculating its address. We have to keep track of address of first element of the array this 
is known as the base address of the array and can be denoted as Bost^Array Name). 

Consider an army 5, having base address denoted as Base (S’). 

AddreM of any other element of in my S can be calculated by using the following 


Loc< - s k) » Bau(S) + ur(fc - A) 

of the array element in terms of C ^ Dcot of ** «*»y» w is the size of tne oa» k 

the start of the smyi ^i^ 1_>* ~ i* the distance of the S k element fr 

Consider ft. _’ K " >, ^ * aniy. 

Ihc array 5 having lb * 1995 


address or location 
the size of the data ty 


Consider tk» k — °ttne array, 

**-2002 lbW * “ abo,,ed •ample of 
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Array 


| 200 | 

p300 | 

t 250 1 

[302 | 

|~400 | 

f202 | 

f500 | 100 | 

1995 

1996 

1997 

1998 

1999 

2000 

2001 2002 


*1? ™ “? S stor | es m ' e S ers “d we know, usually, integers occupy 2 bytes of 
memory. Thus w is equal to 2. Moreover, consider the first element of the array S is 

s ore ^ ““ pUter 1 “ m °!£ at locati °n 1500, thus consecutive anay elements will be 
stored at locations 1502,1504 and so on as shown in below figure. 

1500 1502 1504 1506 1508 1510 1512 1514 

1 200 | aw | 250 | 302 I 400 | 202 | 500 \~wT\ 

S 1995 S 1.996 S 1997 S 1998 S 1999 S 2000 S 200 l S 2002 

Memory Representation of Array with Base Address 1500 
Here, Base(S) = 1500 


w 2 as each element occupies two bytes of memory space 
lb = 1995, lower index of the array 

Now, if we want to calculate the address of 5[1998] element then we can use the above 
mentioned formula as: 

Loc(S fc ) = Base(5) + vv(/c - lb) 

Loc(S 199B ) = 1500 + 2 x (1998- 1995) 

= 1500 + 2 x3 
= 1506 


The element of thearray 5 with index 1998 is stored at location 1506 in the memory. 

Consider one more example: 

Problem: Suppose an array A having base address as 1532, each element of the array 

takes 4 memory cells and the array’s starting index (or lower bound) is 11. Calculate the 

address of element at index 25 in the array. 

Solution: 

Base (A) = 1532, 
lb = 11, 
w = 4, 
k = 25 

Loc (A k ) = Base (A) + w(k - lb) 

= 1532 + 4(25- 11) 

= 1532 + 56 = 1588 

So, the element of the array at index 25 will be stored at location 1588 in the memory. 


25 
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are: 

• Traversing 

• Insertion 

• Deletion 

• Searching 

• Sorting 

• Merging 

2.4.1 Traversing an Array 

Traversing operation refers to processing or visiting the elements of the array. Consider 
an array 5 mentioned in previous example, we want to print the turnover of each year or 
we want to calculate the total turnover from year 1995 to year 2002 then we have to 
traverse the array 5. Here in this example, traversing the array means visiting each 
element of this array and reading the turnover for each year. The general, algorithm for 
traversing the array 5 with lower bound lb and upper bound ub as follows: 

Algorithm: Traverse the array 'S' for printing the elements of an array with 'lb' as 
lower bound and 'ub' as upper bound. 

Step 1: Set / = lb 

Step 2: Repeat Steps 3 and 4 While i < ub 


Step 3: Print: 5[t] 

Step 4: Set l = l + 1 


//traverse the i th element of the array S 


[End Loop] 
Step 5: Exit 
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Algorithm: Traversal operation of the array 'A' used to calculate the sum of 
elements of an array A with 'lb' as lower bound and ' ub ' as upper bound. 


Step 1: Set! = lb And Total - 0 
Step 2: Repeat Steps 3 and 4 While l S ub 
Step 3: Set Total - Total + A[l] 

Step 4: Set l — l + 1 

[End Loop] 

Step 5: Print: Total 

Step 6: Exit 

Explanation: 

In the above algorithm, step 1 assigns the value of lower bound of the array to a 
variable i and a variable Total is assigned with value 0. Thus, the sum of elements of 
the array A initially is 0. Step 2 is used for the loop which is executed from lb to ub. 

In step 3, the value of the I th element of an array (i.e. A[i]) is added to the previous value 
of Total and in step 4, the value of l is incremented. Steps 3 and 4 are repeated till the 
value of i becomes larger than ub. 

After exiting the loop, the variable Total has stored the sum of all the elements of the 
arra y A and is printed on to output device in Step 5. ____ 

Traversal operation can be used to find the maximum, minimum or average of the 
elements of an array. Readers may take these algorithms as an exercise. 


2.4.2 Insertion in an Array 

capacity of storing 15 elements and th more dement in the array. Insertion of an 

- J * move one 

position right to make space for the new e etnen . already 

o Aments and 5 elements are already 

Consider the following array of capacity o 
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A Simplified Approach to Data Structures 

Here, we want to insert a new element in the array at 4* poaition with its value RnvL 
Now! we need to move the element at 5“ poaition to 6* poathon and the element at * 
position to 5* position to make the space for the insertion of new »l«nentat 4 position. 
Thus, such element movements will make room for the new e cn*en posi ion. 

Now, we can insert the new element Ravi at 4* position as shown in igure eow. 

Anil 1 Ravi |PawanlNaveei _ 

1 2 3 4 5 6 ? ® 

Array 'S' with new Element Inserted at 4 th Position 
Algorithm: Inserting an element 'New' at k th position in the array 'S' of size 


'ri where 1 < k < n 


Step 1: 

Repeat Steps 2 and 3 For I = 

n To k 

Step 2: 

Set S[t + 1] = S[l] 

//Shifting of i sh element to (i+l) th position 

Step 3: 

Set l = ( - 1 

[End Loop] 


Step 4: 

SetS[fc] = New 

// Inserting new element at kf h location 

Step 5: 

Setn = n + 1 

// Increasing the number of elements by 1 after 
insertion 

Step 6: 

Exit 



Explanation: 

In the above algorithm, step 1 is used for looping step 2 and step 3 from ntok i.e. from 
last index (n) to the index at which element is to be inserted (k). 

Within the loop, step 2 and step 3 are used to shift the previous position element to the 
next position. We exit from the loop when all the elements from index k to index n are 
shifted one position nght and the index position k becomes free for insertion. 

Outside the loop, the step 4 is used to insert the element New at k th mrW nf 
jitep S is used to increase the total number of elements n hv 1 lndex of the array. 

2.4.3 Deletion from on Array 

Deletion operation refers to removing an -vie*; i 

any position can be removed from the arrav Rem T? fr ° m ** * y ' The dement ■ 
airay is very simple operation as no data movem T ° f “ e ' 4ment from the endofth 

an element IfoT.T** “ this operation. On th 

zz> a ** ^ nex * 10 sts: : 111 *■“ eieme “ 

De move d one position left i 
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Array 


Consular m miv, f havui* 4 aUtrur*/.* « c®** 

[ m Aauft }^ A.ltn | 4*n f gg-ii I f «r» j | 

* ? » 4 i * ? § 

A* \tr»y S' «*» 4 

;' i W--*?* *«". •; ’■•■'*••■ '■ ■■■■ ■-..; i' 1 * 4 ; : V m* ,- t • <?-t * ‘ " 

s^«wr.< *' ' v. 'v . r.f v, i’’ »:ir~»rrc it. 7 »:n:.t\Ti 

6l» v ‘ ’ ’ **'•-■'.•- TV »r*i t .fe'.’-.A'.ft !i*?:-e:TC tiV.’v?, •«« f 

^ r[ v ; • | .'.17, |; | >• (» > p, *H ! 


t J 1 4 * * \ 

\rfi i ; « r »* n* <-;*i «•, * '•»•*» *« '?•*/• •*''> 

i < y 5 ”■ 


SW \ 
: 

'•ft* * 


........ j -. •■ ’ : • - f - k ’ - \ 


- r rr * 5*i * i] 

9rtf * f * J 

t ri-'’ 

», — n - * 

Ft:- 


-*• •• • fj : ' »• * .'rr;;'r »• 




I* tpn i Mrn 

: • ‘ : • ■ 

’•?* :-,Ut 1‘. •-• •• ******* ‘ ■ ,: 


irrt tin \ 

«MM «||M. «r. 

irtiVt k * \ to rtklf.t * *» * ‘ t v,: ^ 

qm*« gUt>««9Aj» tf+mmmu+mamtv *** 



2.4.4 Starching in an Vrr*> 

. .. •>,» r •« r :!f ifiiw! etanant a *» «^7 ; * s - ®* 
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2.4.4.1 Linear Search 

. anniifti when we have no knowledge about the arrangement of th» 
whether the data stored »the -ay « sorted1 ormot Int the u£ 



^t;^r d ==^ the element preset at^ 
1“ position in the array. Then we compare it with the element at the 2 position in the 
This procedure continues until the desired element is found or we reach at the end 
of the array. When we reach at the end of the array without getting the desired element at 
any position then it is concluded that the array does not have the desired element On the 
other hand, the search is successful if the desired element is matched with some element 
at any position in the array else the search is said to be unsuccessful. 


Algorithm: Searching the position of a given element 'Data' in an array 'S' having 
'n' elements. 


Step 1: Repeat Steps 2 and 3 For i = 1 Ton 
Step 2: IfS[f] = Data Then 

Print “Element is found at position”: i 
Exit 
[End If] 

Step 3: Set £ = l + 1 

[End Loop] 

Step 4: Print: “Desired element Data is not found in the array” 
Step 5: Exit 


Explanation: _ 

number of elements^say nf ituhean-ay. ^ ^ 3 “ d ** loop is re P eated for the total 
At step 2 within the loop, I th element 

Data. If both the element* are mShe d ,h! ,S com P ared with desired element 
PMtiono the desired element found and exit from ti^e juxigram d ^ Splayed indicating the 
Step 3 is executed if the element at ith P g am ' 

“aX^d iS I S*r d fe«chtag“e iS n« desired element 

repeated!* ' f ‘ he of 1 is still , ess C r ®T “ ^ Then, step 1 

ZXZZZ'r-*- — * d 

£2 fez 


1f\ 
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searching algorithm can be measured by counting thenumbJ^of * peXlty of any 
in that algorithm. Consider an array A with n elem™!^? f compansons Performed 
position of a given element, two cases arise whilf ^ array ’ while findin 8 the 

algorithm: 3086 Wh,le calculatin S the complexity of its search 

• Worst case 

• Average case 

Worst case Complexity 

The worst case is the ease when we find the desired element at the last position i e at n“ 
position of the stray or we could not locate the element in the array iS of te. 
cases there w, 11 be n number of comparisons. So, worst case compLty of the Une“ 
search can be expressed as 0(ri). y 3 

Average case Complexity 

The average case complexity is to study the probability of presence of the desired 
element at any position in the array. If the desired element is found at 1 st position of the 
array then only one comparison will take place, if the desired element is found at 2 nd 
position then two comparisons will take place and so on. In general, we can say that if 
desired element is found at k position then there will be k number of comparisons. To 
find the average case complexity, we will calculate the average number of comparisons 
that may take place in finding the position of desired element in an array. Average case 
complexity of linear search in an array having n elements can be calculated as: 

We apply the linear search on this array n times and we suppose, 

Desired element being at 1 st position, No. of comparisons = 1 

Desired element being at 2 nd position, No. of comparisons = 2 

Desired element being at 3 rd position, No. of comparisons = 3 


Desired element being at n lh position, No. of comparisons - n 

Total Number of comparisons inn executions = 1 + 2 + 3 + - + n 

n x (n + 1) 
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niimber of comparisons unu m«) - v "«* 

Here, we can say that on an average * ™ Big 0 notation we can express the 

b e W fof«he,o«rof ***** „ 0(n) as comp ,exi«y . expressed « the 
average case complexity oi m»> 
known functions as discussed in chapter l. 

2.4.4.2 Binary Search 

i _ n if \c Vrtovvn th&t the elements in the Eur&y 
Binary search can be applied on an array or decreas j ng order. The logic 

are sorted alphabetically or . d t day uf e for finding a word 

behind the binary search is same as that we use in our uay j 
in the dictionary. While finding a word in the dictionary, we do not search die word m 
linear order i.e. word by word from beginning to end. Instead we open the dictionary in 
the middle and select the portion of the dictionary that contains the word (first half or the 
second half of the dictionary). Again, we open the selected portion of the dictionary from 
its middle and select the portion containing the required word. This procedure is repeated 
again and again until the desired word is located. In this approach, we locate the desired 
word very quickly by discarding a portion of dictionary at every step. 

When binary search algorithm is applied on an array, the first step is to find the array 
index of middle element using the formula: 

Middle Index = <nde * + Mp P er index 

2 

2lTl«“eir'.T "2 d T nt presem at ,he midd,e wi* the desired 

element. If element at middle index position is the desired element then we will stop 

searching. Otherwise, after examining the element at miHrn» • a • • ^ 

Which half portion of array may contain the desired eUmentWm T' 0 ”,’ T ^ 
smaller than the element at middle in<w „ v , ement - the desired element is 

for further searching else second half of theT ^ * n ^ ^ ° f the array wil1 be used 
same Procedure WlU be — further searching. The 

•hie index position with the the “ * 

anay. This process is repeated aoain and Performed the selected portion of the 

—«. «rea eir: tz 
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Array 


Consider a sorted array A having 9 elements as shown in figure below: 

p7 I 12 | 18 1 40 | 55 | 66 | 85 | 94 | 101 | 

123456789 
A Sorted Array 'A' with 9 Elements 

If we want to find the location of element 85, then the binary search procedure will be 

applied as follows: 

'The lower index of array = 1 
The upper index of array = 9 
The middle index of the array can be calculated as: 

1 + 9 

Middle Index — 2 

= 5 

Now, A[middle index] = A[5] = 55 and this element at A[ 5] is compared with 
desired element 85. 

Here, A[ 5] = 55 < 85, therefore we set the lower index as 6 and upper index as 9 
6 + 9 

Middle Index = —^— 

= 7 

Now, A[7] = 85 and this element at A[7] is compared with desired element 85. 



lere, A[7] = 85 = Desired element, therefore we will stop the search here. 

) n iy two comparisons are made to locate the element using this binary search whereas, if 
,q U se linear search to find the same element then we need 7 comparisons. 

Jgorithm: Search the position of an element 'Data' in an array 'S' with lower 
ound 'lb' and upper bound 'ub'. 

tepl: Set Start - lb, End - ub 

tep 2: Repeat Steps 3 to 5 While Start <r-End 

c xr„ mi„ = Inteaer ( s J^l£) //Roundoffthe value 

If S[Middle] - Data Then 

Print: “Element is found at position”: Middle 

Exit 
[End If] 
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... . . ^htoPataSW Ctures. 

< < Da aT T\ 

Step 5: _ * _ Middle 4 


Set Start = Middle + * 


Else 


Set End = Middle 


- 1 




[End If] 

[End Loop] 

Print: “Element does not exist in the array 
Exit 



Explanation: are assigned the values lb and 

in die above algorithm, two „ repea ,ed while Start is less than or 

ub respectively. Step 2.s used for die loop according to the condition 

equal to End. The values of Start and tno ar 

within the loop. the middle value of start and End 

variableMO that tlwbksinent at tadex Middle is checked for desired element Data. 

At step 4, the element at index Middle is compared with desired element Data If“there 
is match then an appropriate message is printed and exit from the program. If the e 
at Middle index is smaller than the desired element Data then the des tfed element may 
be present in the 2 nd half of the array so we set the variable Start = Middle + l. it 
the element at Middle index is larger than the desired element Data then it means 
desired element may be present in the 1 st half of the array so we set the variable End = 
Middle - 1 in Step 5. In case the value of Start becomes larger than End, we exit 
from the loop and declare that the desired element is not present in the array. 


Complexity Analysis of Binary Search Algorithm 

The best case for binary search occurs when the element being searched for is exactly at 
the middle of the sorted array. In this case, only one comparison is required to find that 
desired element giving a best case mntime of 0(1). 


Worst case for the binary search occurs when the element is not found in the arrav Since 
binary search halves the sorted arrav in each stpn 1m +;i m me array, since 

halved. Total number of comparisons i e the effiripnr' f v 6 ^ n ° va ues ^ at can 
be expressed as a logarithmic function. For calculating bmary Sear ° h in this case can 
suppose that the number of elements in the ar ™x 8 tbe worst Case com plexity, let us 
assume tha, each time, a n = Aho. we 

whrchone half is choosen which may contain the desiredeltmern 11 mt ° tW ° halveS frora 



af 

n 


In 

cc 

is 

at 


S 

si 
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Therefore, after 1st comparison,number of elements remains = -r = — 

2 1 2 

After second comparison,number of elements remains — —? = — 

2 2 4 

After third comparison,number of elements remains = — = — 

2 3 8 


a/ter x th comparison, number of elements remains = — = 1 

2 * 

Theref ore, Total number of maximum comparisons = x = log 2 n 

as 2* = 7i =* x = log 2 n 

In the average case, the element is found during any comparison. Thus, average case 
complexity is less than that of worst case complexity. In Big O notation, the complexity 
is taken as 0{log 2 n ) because it halves the array until it is able to get the element in the 
array. 

Suppose we want to find an element from an array sire of one million. In case of binary 
search, maximum (in worst case) comparisons required will be only 20 
(can be calculated using log 2 n). This is just because on every comparison at the 
middle of the array, the array size reduces to half. In case of linear search, the maximum 
number of comparisons will be one million. 

Total number of maximum comparisons = x = log 2 n 


Difference between Linear Search and Binary Search 


Linear Search 

Binary Search 

1. The elements of the array need not to be 
in sorted order. 

2. The complexity of linear search is 0(n). 

3. Linear search is accomplished by 
comparing desired element with each 
element of the list (array) starting from 
1 st element of the array. 

1. The elements of the array must be in any 
sorted order. 

2. The complexity of binary search 
is 0(log 2 n). 

3. In binary search, the desired element is 
compared with middle element and 
selecting the half portion of the list in 
which element may be present. This 
procedure of halving the list is repeated^ 
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ii l iii ' II' - 1 -‘" nataStructur '’' 1 .~i "i iT 

- J|, a , element is not present. 


4 . Linear search ean be spplied on any 

linear data strUC struc ture do not 

tsrvscr « 

locations. 


The binary search can be applied only 
IS array because the elements of array 
“e in contiguous memory locations. 


1 


2.4.5 Sorting of an Array array in some logical order. The 

Sorting an array refers to arranging the element^ ^ „ 1ements The sorting operation is 


Sorting an array refers to •” „ rd er of elements. The sorting operation is 

Consider an array S having 10 elements as shown below. 

r I w I nil I 47 I 49 I 80 | 87 
! 2 -3- 4 5 6 7 8 r 10 

A Sorted Array 'S' with 10 Elements 

It is evident for the array S that S[l] < S[2] < S[3] < S[4] < S[5] < S[6] < S[7] < 
S[8] < S[9] < 5[10]. Thus, the elements of the array S are sorted in increasing order. 


There are several different methods for sorting the array elements. Here, a simple sorting 
technique which is popularly known as Exchange Sort or Bubble Sort has been 
explained below: 


Exchange Sort or Bubble Sort 


The basic idea behind the bubble sort is explained by taking an example of the array S 
having n elements 5[1], 5[2], S[3],. and S[n] 


The algorithm starts with comparing S[l] with 5 [2] and exchange will take place 
^ N° w > S[2] is compared with S[3] and exchange takes place if S[21 > 
S[3] This procedure continues until S[n - 1] is compared withS[nl. In this process, 

n -1 comparisons take place and the whole process is known as a pass. After first pass 
the largest element of the array occuoies the ^ P 5 

elements of the array are still unsorted although the positions of'tb^^’i BUt ’ ° thei " \~ 1 
changed. ® e P osl hons of these elements may have 


The next pass will work for the first n-i »i 4 ^ 

wSm W 'f S[ u ] and exchan ge takes place if 5m > ^ sec °nd pass S[l] is 
5[3] and exchange them if S [21 > crgi tt,- S[2]. Now, S[2] is compared 

compared with S[n - 1 ], this 2 "S * !' ‘ procedure continues until S[n - 2] is 

pass, n - 2 comparisons take place and second 


largest < 
Again, t 


Now, ir 
because 
third pi 
first n • 


This p: 
pass S 
compl 
last p: 

bubbl 
the pi 


It is t 
eleme 


Cons 


This 

foil! 
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Array 

largest element of the array occupies the (n — l) th position i.e. second last position. 
Again, the first n - 2 elements of the array are still unsorted. 

Now, in the third pass this procedure will be repeated on first n — 2 elements of the array 
because last two elements are already in the sorted order. After the completion of the 
third pass, the third largest element of the array will occupy the third last position. The 
first n — 3 elements of the array are still unsorted. 

This procedure continues till we reach the last pass i.e. (n - l) th pass. In the (n - l) th 
pass 5[1] will be compared with S[2] and exchange takes place if S[l] > 5 [2]. After the 
completion of (n — l) th pass, the whole array will be sorted in increasing order. In the 
last pass, only one comparison sorts the remaining two elements simultaneously. So, 

bubble sort algorithm requires (n — 1) passes to sort an array with n elements and 
the pass number k will have (n - k) steps. 

It is to note that in bubble sort, the lightest element in the array bubbles up and heaviest 
element settles down. 


Consider an unsorted array 5 having 6 elements as shown below: 


1 8 

7 

5 

11 

15 

2 

1 

2 3 4 5 6 


An Unsorted Array 'S' with 6 Elements 

This array will be sorted in the increasing order using bubble sort algorithm as shown in 
following procedure. 

_ — f _ /C fT* -A XA.! M MB 1 ~* A ■ 1 ■" I — S 

Pass 1: Numbe 



PI 

5 

1 11 1 

1 15 1 

1 2 1 

1 

2 

3 

4 

5 

6 


5[1] will be compared with S[2], As S[l] > S[2], exchange takes place. 



5 [2] will be com] 


pared with S[3], As S[2] > S[3], exchange takes place 



S[3] will be 


compared with S[4], As S[3] < S[4], No exchange takes p.aee 
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nata 'ltrn^ t1,rps 

A --rH^ApproachtSir. , T1 - exclli fflgc takes place. 

1 2 


5 [ 5 ] will be compared with 5 [ 6 ]. As 


S[5] > S[6l exchange takes place. 



The largest element 15 has 


Pass 2: Number of Steps 


4 5 * 

1 obtained its proper position S[6] in 5 comparisons. 


= 2 = 6 - 2 = 4 



S[l] will be compared with S[2], As S[l] > S[2], exchange takes place. 


i 5 

11 1 

2 ! 

1 15 1 

19 3 

4 

5 

6 


5[2] will be compared with S[ 3]. As S[2] < S[3], No exchange takes place. 


5 

7 

8 

11 


15 

1 2 3 4 5 T 

S[3] will be compared with 5[4]. As S[3] < 5[4], No exchange takes place. 


5 

7 

8 

V it ^ 

2S1 15 | 

1 

2 

3 

4 

5 6 

ed with S[5]. As 5[4] > 5[5], exchange takes plai 

| 5 | 

LzJ 

LjlJ 

1 * 1 

1 11 1 15 I 

1 

2 

3 

4 

5~ L -T“ J 


The 2 nd larges, element 11 has obtained its proper position S[ 5] 


in 4 comparisons 
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5[2J wm be compar ed with ,S[3]~ As S[2^ c S[3],jVo exLg. L plac , 

, —— ~n 1 is~ 

^ 2 3 4 g g 

5[3] will be compared with 5T41 As ^ cm 

L^j-As^[dj > 5 [ 4 ] ) exchange takes place. 

5 \ 7 I 2 I l I 11 I 15 

1 ~ r 4 5 1 6 

The 3- largest element 8 has obtained its proper position S[4) in 3 comparisons. 


Pass 4: Number of Steps = n- 4 = 6-4 = 2 



S[1 ] will be compared with S[2], As S[l] < S[2], No exchange takes place. 

I 5 1 I 8 I 11 I 15 I 

1 2 3 4 5 6 

S[2] will be compared with S[3]. As S[ 2] > S[3], exchange takes place. 


pr 

2 

i ^ 

8 

11 

15 

1 

2 

3 

4 

5 

6 


The 4 largest element 7 has obtained its proper position 5 [3] in 2 comparisons. 

Pass 5: Number of Steps = n - 5 = 6 - 5 = 1 



5[1] will be compared with S[2]. As 5[1] > S[2], exchange takes place 


I 2 I 5 | 7 I 8 | 11 | 15 | 

1 2 3 4 5 6 

The 5[1] and S[2] have obtained their correct positions in just a single comparison. 
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ill in Structures—- or der u.tog«*>ebubble.ort 1 

lucre**!®® or ” I 

Algorithm: Sorting *® 1 

technique. < I 

Step 1: R«P~‘ Forp “ 1W ” I 

, For l = lton-P 1 

step If S[ll > s[i + 11 Then «, 1 

Sttp3: Exchange 11 1 

[End Loop] 

[End Loop] I 

Step 4: Exit l| 

Explanation: , for ,h e loop which is executed for the total number | 

T* m > a., a .oop r >—£ g r P p r^ 

s"pass P p. In step 3, the two elements are compared and| 

exchanged if required. I 

Complexity Analysis of Bubble Sort Algorithm 

The complexity of any sorting algorithm is analyzed through the number of comparisons 
required during the sorting procedure. In this algorithm, we can easily determine the total 
number of comparisons. As we have already observed that an array of size n gets sorted 
after n - 1 passes. In the bubble sort, n - 1 comparisons take place during the I st pass 
which places the largest element of the array on the last position, n — 2 comparisons 
takes place in the 2 n pass which places the second largest element of the array on the 
second last position, k th pass requires n-k comparisons which places k th largest 

( " 7j t f +1 ]“ f osi,i ° n the array and the last pass requires only one 
comparison. Therefore, total numbers of comparisons will be: 

/(«) = (n - 1) + (n - 2) + („ - 3) +. + (.n-k) + +2 + 1 

= (n- 1)+ (n - 2) +. + 2 + j 

_ (n- 1) x n 


+ 2 + 1 


(n - k) + + 2 + 1 


L 

l-b.,0 notation, the complexity of bubble 


sort algorithm will be 0(n 2 ' 
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_ Array 

2.4.6 Merging of Arrays 

Merging of arrays refers to combining the elements of two linear arrays into a single 
array. We can merge the arrays in two ways: 

First, when elements of the arrays are not sorted and merged array is also need not be in 
the sorted order. Thus, we can merge the given arrays into a single array end to end i.e. 
the elements of first array are copied into a third array and then the elements of second 
array are copied after the elements of the first array. 

For example, consider two arrays Al and A2 as shown below in figure a and figure b. 
These arrays are merged into a third array A3. 


8 

7 

n«i 

Pi“| 

2 

32 

1 25 

1 

2 

3 

4 

5 

6 

7 


a: An Unsorted Array 'Al' with 7 Elements 
15 | 45 | 21 | 9 | 99 | 3 


1 2 3 4 5 6 

b: An Unsorted Array 'A2' with 6 Elements 

After merging the elements of arrays Al and A2, the third array A3 will be as shown 
below: 


rn 

| 7 | 90 | 75 | 2 

32 j 25 

fin 

| 45 

J1T1 

cn 

99 | 

Z] 

1 

2 3 4 5 

6 7 

8 

9 

10 

11 

12 

13 


An array 'A3' with 13 Elements after Merging Arrays 'Al' and 'A2' 

The second case is, if the elements in the given arrays are sorted and we want to merge 
them into a third array which is also required to be in sorted order, then it can be achieved 

by two different ways. 

In the first approach, the given sorted arrays are combined end to end and then elements 
of the third combined array can be sorted by using some appropriate sorting algorithm. 
But, this approach is not efficient. 

In the second approach, the third array will be sorted while merging the given sorted 
arrays. In this approach, the elements of the given arrays are compared and based on *e 
comparison, it is decided that which element wtll go mto the ted array ^consider 
two arrays Al and Al as shown below in figure c and d respectively. These arrays are to 
be merged into a third array >13 which is required to be in the sorted order. 


12 3 

c: A Sorted Array 'Al' with 3 Elements 
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I— 1 2 J 4 

A Array '^2'«Hh 4 Elem^ts 

d: A Sorted Ar y ^ is compared with A2[l] 

«. it?’*“" “ “ 

-*-§^ 1 X 31 ] 

1 2 3 Aril As A2[l] < Al[2], so A2[l] wil 

Then, the element Al[2] is j e . A3[2] as shown below: 

placed at second position in the third array no --.-- 


Now, the element Al[2] is compared with A2[2], As S ° 41121 ** 

placed in the third array 243 at the third position A3 [ ] __ 


1 2 3 4 5 6 7 

Now, the element Al[3] is compared with A2[2]. As Al[3] < A2[2], so Al[3] will be 
placed in the third array A3 at the forth position A3 [4] as shown below: 


CM 

3 

7 

8 





1 2 3 4 5 6 7 

Now, all the elements of A1 are transferred to array A3 and a few elements are left in the 
second array A2 . The remaining elements of the array A2 will be copied as such at the 

42 to i/itflhat t^ 3 aS Sh ° Wn below ’ The reason for copying the remaining elements in 
A2 to A3 is th at the remaining elements in A2 are already in sorted order: 

2 


— r — i 1 

“,criss - « /. taw. 

the e r ayS A1 t and A2 res P e ctively and 'u/ii' **5^ are the lower bounds of 
the given arrays A1 and ^2'respective^ 1 and ^2'are the upper bounds of 

Ste Pl: Set l = ibl , _ y 

zi 

IMl W < A2[f] Then 



42 


Scanned by CamScanner 













SeM3[*j = Al[l] 
Set/ « / + i 

Set * = k + l 


Arra 


Else 


Set >13 [ft] = , 42 m 
Set i = j + i 
Set Ac = Ac + i 


[End If] 

[End Loop] 

Step 4: Iff > ub nhen 

While j ^ ub2 

Set A3 [Ac] = A2 [/] 

sety = y + l 

Set Ac = Ac -f l 
[End Loop] 

Else Ify > U b2 Then 
While / ^ ubl 

Set 3 [Ac] = Al[t] 
Set / = / + j 
Set A: = k + 1 
[End Loop] 

[End If] 

Step 5: Exit 


Complexity Analysis of Merge Algorithm 


' f ui any aigoritnm is represented in ten 

°ierge algorithm, our input size is k. Therefore, 



of arrays A1 and A2. As we know, 
in terms of input size, so, here in the case 


The size of input data for merge 


sorted arrays >11 and >12 of size 
-isons that may take place during 


’uipicxuy oi tne merging 
of comparisons that are 


f(k) = fc - i = 0 (k) Here, k = m + n 
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A e;~pliK“H Ap proach to Data _ __ ^ 

Thi. i, the worst ease complexity of merge algorithm as we have taken the nuxi^ 
5 Zt£m Z may take place while mergmg two sorted artays into 

third one. 

2.5 Multidimensional Array 

As discussed in section 2.2, the elements of one dimensional array are referenced using 
only single subscript. This is the reason that these arrays are also popular with the name 
of single dimensional array. Multidimensional array is the array in which elements are 
referenced by using 2 or more subscripts. The array whose elements are referenced by 
two subscripts is known as two dimensional array. The array whose elements are 
referenced by using 3 subscripts is known as three dimensional array. Similarly, the array 
whose elements are referenced by using n subscripts is known as n dimensional array. 

Two Dimensional Array 

Consider an example of a class result as shown below: 


101201 

78 

101202 

86 

101203 

45 

101204 

34 

101205 

90 


The above table tells us the score of five students in the class. First column specifies the 
roll number of students and second column specifies the marks of the particular student 
whose roll number is mentioned in that row. If we need to store this table in computer 
memory, we need two dimensional array as it has two different columns. If it had only 
one cota, one dimension array must be sufficed. So. in this table, five rows and two 
™iumns_am t her e. Hence, this table (mate) is of S x 3 order. Thus, it consists of 

by T subscri 7 7 

««>y. Here, in this case, each element of Ih'"* ^ C ” number of columns in the 
subscripts l and j such that: C arra y ^ can be referenced by using two 

1 * 1 * r *ndl z j £ c 
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The elements of two dimensional arrays A can be referenced 
shown below: 


Array 


using any of the notations 


a lt OR A[i][j] OR 

Consider the example of two dimensional array A of order 2x3. Here, array A has 2 
rows and 3 columns. Total number of elements in arrays A is 2 X 3 i.e, 6. 

12 3 

A s T^ 1 a i3"l 

2 Lftl a 22 *23 J 

A Two Dimensional Array with 2 Rows and 3 Columns 

Here, it must be observed that each row contains the elements whose first subscript is 
same and each column contains elements whose second subscript is same. 

Revisiting the example of class result card, the array is of order 5x2 in which, 

a n = 101201, a 12 = 78, a 21 = 101202, a 22 = 86, a 31 = 101203, a 32 = 45, 

a 41 = 101204, a 42 = 34, a 51 = 101205, a 52 = 90 


2.6 Memory Representation of Two Dimensional Array 


Consider a two dimensional array A of order r x c. While representing a two 
dimensional array on paper, we write its elements in rows and columns. But, when such 
an array is stored into the computer memory, its r x c elements will occupy r x c 
consecutive memory locations. There are two different ways to store the two dimensional 
array into the computer memory, either row by row which is called row major order or 
column by column which is called column major order. 


'he choice between the two ways for storing the two dimensional array into the computer 
uemory depends on the programming language. The representation of two dimension j 
rray using both the ways i.e. row major order and column major order are shown below 

or an array A of order 2x3. 


4i 


l 12 


*13 


*21 


*22 

Row2 1 


4 -- Rovvl-—H-R ow2 -* 

Row Major Order Representation of Two Dimensional Array 
shown in the figure above, die elements of file firs, row of the array are stored first 
i after that, elements of the second row are s tored. _ 

— — —* r^T 


* A* 


r~57TT «n a * I a ” I 

4 _coll —*H-con-- Co1 

Column Major Order Representation of Two Dimensional Array 
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A -in r 1 ^ Approach 11> qwicture9 .t^ents pfthe first colum^l 

- ' . .u. fijmre above lot the second column are stored a#! 

50 ° n . wh jle describing the one ^j® e ^°toeping^thr e addreS8 crfonly'firjt | 

As mentioned earh ® ’ , ment of the array, but by P the 0 f any other I 

element of thTwray cal " * fof 

dement in the array. Similarly, same 

multidimensional arrays. ^ by the address of the first 

consider a two dimension^ amy d° f s'»J s ^ ^ , ompute the address of any 

element of the array i.e. «[U] ™ formula depending upon the approach 

other array element a[l,j] using column major order: 

used for storing the array i.e. either row major order 

Address of («[(][/]) = Base(A) + w[c(l - Ibr ) + U 

when array is stored in row major order 

Address of («[«][/]) = Base(A ) + w[(i - Ibr ) + r(j - Ibc )] 

when array is stored in column major order 

Here, Base(A) is the address of first element of the array A 

w is the number of memory cells occupied by each element of the array 

Ibr is the lower index of the row 

Ibc is the lower index of the column 

r is the number of rows in the array A 

c is the number of columns in the array A 

t,J is the index of array elements 

Consider a two dimensional array A of order e y a re , 

base address of array is 500 and each arrav nu ? 5 r0WS 311(1 4 colu mns). Supposi 
programming language uses row major oMer e ” ent occu P les memory cells. If th< 
nddress of the element a[3][3] can becalculatedby elements - then *' 

Ad dress of m[)]) = BaseW + _ g mUk: 

Address o/(a[3] [3 ]) = 500 + 2[4(3 + ^_ + « ~ lbC ^ 

= 500 + 2 [8 + 2] 

* 520 


II the same array is stored in column 


^ then ** address °f the element a[3][1 
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can be calculated by using the formula meant for column major order: 
Address of (a[i]\j]) = Base (A) + w[(( - Ibr) + r(j - Ibc )] 
Address of (a[3][3]) = 500 + 2[(3 - 1) + 5(3 - 1)] 

= 500 + 2 [2 + 10] 

= 524 



It is important to note that the lower index for any dimension is taken as 1 if it is not 
explicitly specified. Programming languages which allow multi-dimensional arrays often 
permits lower index for the dimensions to be other than 1. 

Consider a two dimensional array S[3 : 6,-4 : 2]. Here, colon is used to separate the 
lower and upper indices for the dimension and comma is used to separate the dimensions. 
In the array S, 

The lower index of the first dimension (Ibr) = 3 
The upper index of the first dimension ( ubr) = 6 

The lower index of the second dimension (Ibc) = -4 
The upper index of the second dimension (ubc) = 2 

Length of first dimension of array S i.e. number of rows (r) can be calculated using the 
formula: 

r = ubr - Ibr 4- 1 
r = 6- 3 + 1 
r = 4 

Len g th of second dimension of array S i.e. number of column (c) can be calculated using 
the formula: 


c = ubc - Ibc + 1 
c = 2 — (“4) + 1 
c — 7 


Here, array 5 will have 4 x 


7 i.e. 28 elements with indices: 


S3,- 4 s S3 ( .3, S3 ( .2, S3,-l, S 3 ( 0 s S3,Is S3, 2 s 

S 4| 4, S 4> .3, S 4; .2, S 4 ,„ S 4 ,0s S4,ls S4,2 s 
S 5,4s S5 ( .3, S5,.2s Sj,-ls Ss.Of S5,ls Ss,2s 
S6,-4s S6.-3, S6,-2s S6,.ls S6,0s S6,ls S6,2 
To calculate the address of any element 


of the array S, the above m 


entioned formulae 
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v(i * Y 11 proach to pata 11111111 . ^ is a collection c 

^ amplified Ap£_— ~^~Z7t(2 5 5 ' 1 3 ' n f T we have to specify thtg 

Consider a three dim ensl ^ al t0 re fer any elel ^ en f ^{ s array are stored in ra 



Sequencing of Elements of a Three Dimensionn. Army T in Row Major Order 

The same array when represented in column major order then sequence of elements m the 
memory will be as shown in figure below: _ _ 




>3,a,* I—»1 4 :,a1 


4.3.A-►) 'did]-*1 4.3.4 j- A 4,11.1- A 4,1.5 f-*1 4,1,3 I- A 4,1,0 - A 4,a,5| H 4.3.5 


4^1 4j,s|—•»| U,fs •—» 4.3.6-» 4.3.8 -*• 4.J.J-► 4.3,5-* 4.1.6 -► 4,1,6 ► 4,1,8 




4*.«l —*\ 4 j,< I 


4 a.a ► 4,a/1 


Sequencing of Elements of a Three Dimensional Array T In Column Major Order 

Consider a three dimensional array >1 havino/h „ i , 

of first dimension, lb 2 and ub 2 as lower Index as lower index and upper index 

3 and ub 3 as lower index and upper index U ? per * ndex °f second dimension, 

dimension (l v i 2i i 3 respectively) W ?U be: ° f ^ dime nsion. The length of each 

*i * ub t - ib t + i 

'r=«h 2 -!b 2 + a |- en 8 ,h of first dimension 

<3 = ub 3 - lb 3 + x ength ° f second intension 
There will be , otal ( , x “"8 th °f third dimension 

■hKJS? *Uk] (sleh SSr?*,» ‘he array / We 

8 following formula: b > s| S ub,, lb j- , can calculate the addresl 

S J S «b 2 , Jb a S k s „b,) 
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Array 


For Row major Order 

Address of(A[i][j][k]) 

" + w [l 2 l 3 (i- lb t ) + I 3 (J - lb 2 ) + (fc - i^s)] 

Here, w is the number of memory cells occupied by each array element a nd Base(A ) is 
the base address of the array A. 


For Column Major Order 
Address of (A [(] [/] [k]) 

- Base(A ) + w [(<- IbO + «!(/- lb 2 ) + (* - 1& 3 )1 

Here, iv is the number of memory cells occupied by each array element and Base(A ) is 
the base address of the array A. 

Problem: Consider a three dimensional array M(—2:1, 5:7, 3:4) which is the 
collection of 24 (4 x 3 X 2) elements. Assuming the base address of array is 1000 and 
each element of the array occupies two memory cells. Calculate the address of element 
M [1,6,4] if elements of array are stored in: 

(i) Row major order (ii) Column major order 

Solution: 

In this array: 

lb x = -2 lb 2 — 5 lb 3 = 3 

ubi = 1 ttb 2 — 7 ub 3 — 4 

Ij = ubi — lb 1 + 1 =l + 2 + l = 4 

1 2 = ub 2 - lb 2 + 1 = 7 - 5 + 1 = 3 

1 3 = ub 3 -lb 3 + l = 4- 3 + 1 = 2 

i = 1 ; = 6 /c = 4 

Total number of elements = 4x3x2 = 24 

w = 2 and Base(M) — 1000 


In Row Major Order: 

Address o/(Af [<][/][*]) . . , _ lb )i 

= Base(M) + w [Mad - »i) + *»«- »*> + ( * 3)J 

Address of(M [1,6,4]) + f4 - 3)1 

= 1000 + 2[3 X 2 X (1 + 2) + 2 X (6 - 5) + (4 
= 1000 + 2[18 + 2 + 1] 
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- = 1000 + 42 

= 1042 


In Column Major Order: 

Addressofm ?Zm + *[(*- «w + «.(/- »■> + '- ,2 (k - “»» 

Address of (M[ 1,6,4]) 4 x o x , 4 ~ 

= 1000 + 2 X [(1 + 2) + 4 x(6 - 5) + 4 X 3 X (4 - 3)] 

> = 1000 + 2 X [3 + 4 + 12] 

= 1000 + 38 

= 1038 

Problem: Consider a 3-dimensional array A whose subscript limits are 1 < i < 9, 
-2 < j < 3, 3 < k < 6. If the base address of the array is 2048 and each element 
occupies 4 memory cells then find the address of element A (3,0,4) if 

(i) Array is stored in Row Major Order 

(ii) Array is stored in Column Major Order 

Solution: 

In the above subscript notation, 
i is taken for the 1 st dimension index 
J is taken for the 2 nd dimension index 
k is taken for the 3 rd dimension index 
i.e. 1 st dimension ranges from 1 to 9 
2 nd dimension ranges from -2 to 3 
3 r dimension ranges from 3 to 6 

Here, lb t = I lb - o 

2 “ " 2 ih 3 = 3 

u6 ‘ = 9 Ub 2 = 3 

<1 = ui>! - (4, + 1 
= 9-1 + 1 
= 9 

h = ub 2 - ib 2 + ! 

= 3 '(-2) + i 

* 6 




_ 
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I) ■ + 1 

■ 6-3 + 1 

- 4 

Total number of elements ■ 11x12x13 

■ 9x6x4 
- 216 
w ■ 4 

Bast (A) * 2048, 1* 3. / * 0, k * 4 

la Row Major Order 
Address of (A[f][/1(*]) 

- Base(A ) + *(/,!,(/- l&i) + *i U - <*i) + (* - l*i)] 
Address o/(A(3][0](4]) * 2048 4 4 (6 x 4(3 - 1) 4 4 (0 - (-2)) 4 (4-3)] 

» 2048 4 4 (48 * 8 * 1 )] 

* 2048 4 228 

* 2276 


la Column Major Order 
Address of(A\l][J)[k}) 

m Base(A) 4 w ((I - lb t ) ♦ l\(J~ * Mi (* ~ ***31 

Addrtss o/(Mf3][0]|4|) — 204fl ♦ 4 ((.? - »♦*(»- (* J " ♦*«»«-«) 

m 2048 4 4 (2 4 18 4 $ 41 ] 

• 2048 4 296 

• 2344 


2.8 Sparse Arrays 


4*0 opal sc ru i 

„, rt itmnvfh^Qil ifflM ID which cIctUCTO tXS 

As mentioned earlier, matrices *ft * f „ co Uectx« of r x c elements 

arranged into rows and columns A ma&wo c cteroco t of * two dimensional array a 
which are arranged in r rows and c column* EaJ> elen^ot a * w becnpt 

referenced by using two subscripts. I subsenpt to represent row mdex 

to represent column index 
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AStojESgg Approachjg-- 

2.8.1 Sparse Matrix of its elements are meaningless. sjl 

A matrix M is said to be sparse ® me8ningle ss elements or we can say that, *, 
tod of matrices contents h.gh dens, y ^ sjgniflcant . if we constder zero „ 

sparse matrix has a very few dent (he matrix which has majority of zero 

meaningless elements then tne s P ar 6 x 5 j s a sparse matrix because maximum of 
elements. The below shown array ol 0 
its elements are zero. 

rOOlOO- 

0 0 0 0 0 

5 0 0 0 0 

0 0 0 2 0 

00001 

-0 7 0 0 5- 

A Sparse Matrix 

Diagonal Matrix 

A matrix M is said to be diagonal matrix if and only if M[i, j] — 0 for i ^ j. That is, all 
the non-diagonal elements are zero. 

5 0 0 O' 

0 7 0 0 

0 0 8 0 

Lo 0 0 oj 

A Diagonal Matrix 

Upper Triangular Matrix 

; f and oniy if Miij] -»*■*> 1 
said to be strictly upper trianeular if 11 +1 j- 16 dlagonal dements are zero. Matrix is 

elements below the diagonal. & 6 iag0nal elements are also zero along with the 


‘5 8 7 9 

0 3 2 16 

0 0 5 7 

Lo 0 0 8 „ 

An Upper Triangular Matrix 


0 8 7 9' 

0 0 2 16 
0 0 0 7 


L0 0 0 0. 

A Strictly Upper Triangular Matrix 



54 


Scanned by CamScanner 












Lower Triangular Matrix 

A matrix M is said to be lower triangular matrix if and only if M[l,J] — 0 for £ < }• 
That is, all the elements of the matrix above the diagonal elements are zero. A special 
case is strictly lower triangular matrix in which all the diagonal elements are also zero 
along with the elements above the diagonal. 


'5 

0 

0 

01 

0 

0 

0 

O' 

1 

3 

0 

0 

1 

0 

0 

0 

8 

9 

5 

0 

8 

9 

0 

0 

.3 

2 

7 

8J 

.3 

2 

7 

0. 


A Lower Triangular Matrix A Strictly Lower Triangular Matrix 

All the above discussed types of matrices fit into the category of sparse matrices. These 
kinds of matrices are generated from scientific applications as these applications generate 
a huge data that may have hundreds of rows and columns with a very few significant 
entries. 

2.8.2 Memory Representation of Special kind of Matrices 

Generally, to store an ordinary n x n matrix into the memory, we need n 2 memory 
locations. But, in case of special matrices which are discussed above, the memory 
requirements can be reduced upto some extent. Some of the techniques for storing these 
special matrices are discussed below: 

2.8.2.1 Method of Linearization 

In this technique, the elements of matrix are stored in a one dimensional array. Only the 
non-zero elements of the matrix are stored and zero entries are discarded. 

Let us store a diagonal matrix M of order n x n in a one dimensional array A. There 
will be atmost n non-zero elements at the diagonal positions of the matrix. The element 
mi i will be stored as element ai, element ntj i will be stored as element a. 2 , and so on 
upto the element m nn which will be stored as element a n . 

5 0 0 0 

0 7 0 0 

0 0 8 0 
.0 0 0 9 

A Matrix 'M' of Order 4 x 4 and Array Representation of the Matrix 

Similarly, in case of upper triangular matrix M of order n x n, there will be atmost 
n x (n +1) 

-~-non-zero entries. 
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An Upper Triangular Matrix of Order n x n 

In the upper triangular matrix of order n x n there will be at most n non-zero entrii 
the 1“ row, (n -1) non-zero entries in the 2 nd row, (n - 3) non-zero entries in th 
row and so on upto the last row which may contain atmost one non-zero entry. So 
number of non-zero entries in an upper triangular matrix will be: 

Total Number of non - zero Elements = n + (n - 1) + (n - 2)+.+3 + 2 

_ n x (n + 1) 

2 

These ^ ^ ) elements can be stored in one dimensional array A with sub 

ranging from 1 to The element m u will be stored at o,, eletn 

demert'a!* ™“ 2 ’,“ d ” ° n Upt ° 1116 element W w> which wil1 be stored 
element a^ m+1)/l . The elements of an upper triangular matrix stored in a < 

dimensional array are shown in the figure below matrix stored m a ( 




The HiTT #f ^ Tr, “ gU,W M * trh to ‘° * ° ne 

the same approach. ter triangular matrix can be stored in a one dimensional array ui 

triangular matrix. One solution to this nmhi matrix or lower part of an i 

matax to be updated if that updatio^caL^the ‘ S * at; do not all °w a lower trim: 

totI'Ltat q l 0 d ai “ f J eCt0r Represent »tton 

mjoZlZ " 0 "-«*elem«terf*e “ **' 

x 

shown below will be stored by vector V 
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'6 0 0 0 0 

0 0 2 0 0 

0 5 0 0 3 

-0 0 0 8 0 


V[1] 

Row ID 

Col. ID 

Elements 

1 

1 

6 

V[2] 

2 

3 

2 

V[3] 

3 

2 

5 

V[4] 

3 

5 

3 

V[5] 

4 

4 

8 


Vector Representation of non-zero Elements of a Sparse Matrix 

However in vector representation, we are storing row id and column id along with the 
element itself, but this approach avoids storage of the zero entries. 

Using this technique, we can store any kind of sparse matrix. That is, the non-zero 
elements of the sparse matrix may not be in any well-defined order. Whereas, you have 
seen that in case of method of linearization, elements of the sparse matrix must be in 
some well-defined order. 

Operations on the vector representation of sparse matrix require the row id and column id 
to determine the position of the element in the matrix. One main disadvantage of this 
representation is addition of non-zero elements to the array or changing previously stored 
non-zero elements to zero values. There is no problem in the case if we want to change 
the value of previously stored non-zero entry to some new non-zero value. The main 
problem arises in maintaining the order of non-zero entries in the vector when existing 
non-zero entries in the array changes to zero entries or some zero entries in the array 
-hsn g ,.« to non-zero entries. In our example of 4 X 5 sparse matrix which is represented 
in vector V. If the element m 3 , 2 changes to zero then vector elements V[4] through 
r[51 have to be shifted one position up. Similarly, if the element m 22 is updated with a 
value 7 then vector elements V{2] through US] need to be shifted one position down. 

2.8.2 .3 Method of Linked Representation 

Another efficient way of representing the sparse matrix is linked representation which we 
will discuss in the chapter on linked list data structure. 
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2.9 Advantages and Limitations of Array 


2.9.1 Advantages 

1. Array is the simple kind of data structure which is very easy to implement. 

2. Address of any element of the array can be calculated very easily as elements 
are stored in contiguous memory locations. 

3. Array can be used to implement other data structure such as stack, queue, tree 
and graph. 

4. If elements of an array are stored in some logical order then binary search can be 
applied to search an element in the array efficiently. 

2.9.2 Limitations 


i. 


2 . 


Array is the static kind of data structure. Memory used by array cannot I 
increased or decreased whether i, is allocated at run time or compile time 

Insertion and deletion of elements are verv 

new element is be inserted at “XT T" 

required to move to create the ennm. #x . n amiy then ’ ele ments ai 
element is to be deleted from the array then"" ?, e ” eW ' °" the other ha »<i, if a 
b= moved to fill the vacated position of the L a ‘ PreCeding elementS needs 1 

3. Only homogeneous elements can be stored i„ ,i 

want to store the data of mixed type theallv Therefore . in case w 

ype, me array cannot be used. 


> 
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Arra 


1 . 


2 . 


3. 

4. 

5. 

6 . 

7. 


8 . 


9. 


10 . 

11 . 


12 . 

13 . 


Exercise 

Describe the various operations associated with airay. 

Explain the memory representation of one dimensional array. 

b^Dt e c^ta‘Sl WhlCh ”* used t0 fmd “ element in an atray. Which one is 


Explain the memory representation of two dimensional array. 

Write down the pros and cons of array. 

“m y e“ ^ SParSe “ What "Presenting them 


Find the number of elements of the following arrays ^[7:19], Y [—2:7] 


a. 


If the base address of array 
then fmd the location of 5“ 


X is 1500 and each element takes 4 memory cells 
element of the array. 


b. If the base address of array Y is 1000 and each element of array takes 10 
memory cells then find the location of 3 rc * element of the array. 


Consider a two dimensional array £> [5: 1, —3:6]. If the base address of D is 1536 
and each element takes 2 memory cells then find the address of d 60 element 
assuming that 


a. Array D is stored in column major order. 

b. Array D is stored in row major order. 

Consider a three dimensional array T with subscript limits as: -2 < i < 5,1 < 
j < 3, 3 < k < 7. If the base address of array T is 2000 and each element of 
array takes 4 bytes of memory, then find the address of T[-2,2, 4] and T [5,3,6] 


a. If the array T is stored in row major order. 

b. If the array T is stored in column major order. 

Explain the binary search technique by taking an example. Give advantages and 
disadvantages of binary search over linear search. 

Explain the following matrices: 

a. Diagonal Matrix 

b. Lower triangular matrix 

c. Upper triangular matrix 

Explain the working of Bubble sort algorithm on the following elements. 

30 20 50 40 10 70 60 80 

Suppose a one dimensional array of size 12 is maintained into the memory, Write 
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the module which: 

a. Finds the smallest element of the array. 

b. Finds the largest element of the array. 

c. Finds the mean of elements of the array. 

d. Finds the sum of non-zero elements of the array. 

14. Consider a one dimensional array Sales[1995 : 2003J which stores the annual 
of a company, write the module which: 

a. Prints the years in which sale was above 50,000. 

b. Prints the years in which sale was between 25,000 and 50,000 

15. How 3D arrays are stored into memory? Give an example. 

16. Compare the complexity analysis of linear search with binary search. 

17. Write down an algorithm to calculate the size of an array. 

18. Write down an algorithm to merge two sorted arrays into a third sorted array. 

l9 ' ImeLTnA* ° f 0rder " Xn ’ Writea " al « orithm to f '"d *e number of non-zero 
20 ' r“r ,thm to fmd thesum0f a11 ‘ ha diagonal elements of a matrix X having 

2 " ^ nUmber ° f eVe ” “d number of odd 

22. Write an algorithm that stores the mark* fin q v , 

dimensional array. Then ealculate the averlge ma^oltch td" in *° * ^ 

(Question, from v.r,„ us Universities previous E x.mln. UoI18) 

■ e advantages and disadvantages of array 

' an algorithm for binary search un. . 

inaiy search over linear search? a ^ the advantages and disadvantages of 

rr:rn ta ;“-^« 

” MU mM 
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7. Explain the following: 

a. Linear Search b. Binary Search 

** average case COmp ^ ex ‘ ty of 1 ‘ near searc h algorithm? Discuss its worst case and 


9. 


10 . 


11 . 


12 . 


13. 


Wnte and explain algorithm for inserting an element into a linear array 

Explain how linear and binary search will be used to search for value 12 from the 
following list of values: 1, 3, 5, 7, 11 , 12, 17, 19, 21, 22, 24 

What is sparse matrix? Explain with example. 


Explain briefly about the limitations of binary search algorithm. 

Using the bubble sort algorithm, find the number C of comparisons and number D 
of interchanges which alphabetize the n=6 letters in word ‘PEOPLE’ 


14. Find the address of the indicated array elements; assume the starting address of each 
array is 1000._ 


Array 

Storage 

Element 

int a[10][20] 

Row major 

a[2][10] 

float a [20] [40] 

Column major 

a[10][10] 

double a[10] [20] [30] 

Column major 

a[5][5][S] 

char a[10][20][30] 

Row major 

a[5][5][5] 


15. Compare the running time T1 of the linear search algorithm with the running time 
T2 of the binary search algorithm when (i) n = 1000 and (ii) n = 10000. 


16. Suppose A is a sorted array with 200 elements, and suppose a given element 
x appears with the same probability in any place in A. Find the worst-case running 
time /(n) and the average case running time g(n) to find x in A using the binary 
search algorithm. 

17. Write the algorithm to delete and insert an element from a linear array. 

18. What is the advantage of binary search over linear search? 

19. What is a sparse array? Explain with an example. 

20. Explain the Bubble sort technique with example. 

21. Write the procedure to insert an element in the middle of an array. 

22. Explain the binary search technique by taking the example. Discuss its complexity 
also. 

23. What is the complexity of bubble sort and binary search? 
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a W02&222 
24, Write an algorithm 


, r—nataStructuig-----,, 

'T^Venr search. Also discuss * complexly in dig 


<"* hv mav? Explain various ways to represent arrays in men,, 

* ZgSSX&J— 

algorithm for binary search. 

(Multiple Choice Questions) 

1. The Average case occur in linear search algorithm 

A. When Item is somewhere in the middle of the array 

B. When Item is not in the array at all 

C. When Item is the last element in the array 

D. When Item is the last element in the array or is not there at all 

2. The complexity of linear search algorithm is 

A. 0(n) 

B. 0(log n) 

C. 0(n 2 ) 

D. 0(nlogn) 

3. The complexity of binary search algorithm is 

A. 0(n) 

B. 0(log n) 

C. 0(n 2 ) 

D. O(nlogn) 

4. The complexity of Bubble sort algorithm is 

B. 0(log n) 

C. 0(n 2 ) 

0(nlogn) 

5. Anays are best data structures 

changing eand the data in the str, 

^'Inmentsofar,, " 

" «’4 y «S e C^ u ^vety’&3SST T 8 because 

8 of the first element 
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and the addresses of other elements can be calculated 

B. the architecture of computer memory does not allow arrays to store 
other than serially 

C. both of above 

D. none of above 


7. The memory address of the first element of an array is called 

A. floor address 

B. foundation address 

C. first address 

D. base address 


8. The memory address of fifth element of an array can be calculated by the 
formula 

A. LOC(Array[5])=Base(Array)+w(5-lower bound), where w is the number 
of words per memory cell for the array 

B. LOC(Array [5])=Base(Array [5])+(5-lower bound) 

C. LOC(Array[5])=Base(Array[4])+w(5-Upper bound), where w is the 
number of words per memory cell for the array 

D. None of above 


9. Which of the following data structures are indexed structures? 

A. arrays 

B. linked lists 

C. both of above 

D. none of above 

10. Which of the following is not the required condition for binary search 
algorithm? 

B There^hould be the direct access to the middle element in any subhst 

C. Sem must be mechanism to delete and/or insert elements m hst 

D. None of above 

11. Which of the following is not a limitation of binary search algorithm? 

A. must use a sorted array f insertion and 

B. requirement of sorted array is expense when a lot 

deletions are needed .. « pi eme nt directly 

C. there must be a mechanism to a J ces , th data elements are more 

D. binary search algorithm is not efficient when 

than 1000. 


12. Two dimensional arrays are also called 
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to 


Structure 


oukl 


A. table* * rra y* 

B. matrix array* 

C both of above 

D. none of above 

,3. Binary search algorithm cannot be appU to 

A. sorted linked list 

B. sorted binary trees 

C. sorted linear array 

D. pointer array 

14. Which of the following operations is not 0(1) for an array of sorted data. Yo 
may assume that array elements are distinct. 

A. Find the i* largest element 

B. Delete an element 

C. Find the i* smallest element 

D. All of the above 

15. A program P reads in 500 integers in the range [0 100] representing the s< 

of 500 students. It then prints the frequency of each score above 50. Whit w 
be the best way for P to store the frequencies’ (GATP CS 2005) I 

A. An array of 50 numbers 

B. An array of 100 numbers 

C. An array of 500 numbers 

D. A dynamically allocated array of 550 numbers I 

16 . K"*7M.rch isapplicable to mult , dinwn , |onil j 

B. False 
17 In 

element in the list. ,,,,r,al ,he opining of the list and check every 

A. Linear search 

B. Binary search 
jr Hash Search 

D. Binary Tree seaich 
18. State True or False. 

for Aching in , 

l Boise, True 13 °fl°g n). 

O ^B-lae 
Bctie, True 
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Chapter 3: Linked List 


3.1 Introduction 

In our daily life, we come across various types of lists like list of friends that are to be 
invited for a party, list of items that are to be brought from the market etc. So, a list can 
be assumed as linear collection of items. A list has a property that its first, second, third 
up to the last element are clearly defined. We frequently perform various operations on 
our lists i.e. we remove certain items from the list or we add some new items into the list 
etc. One way to maintain these lists with computer programming is by means of array 
(discussed in the chapter of array). When these lists are represented in the computer 
memory using array, the linear order between the elements of the list is maintained by 
sequential memory locations as elements of an array occupy the consecutive locations in 
the memory. The main problem that arises when we represent the list using array is their 
slow running time for insertions and deletions, which was also mentioned earlier while 
discussing arrays in the chapter of array. When a new element is to be inserted into the 
array, then the elements after the insertion position are to be shifted one position towards 
the right. Similarly, when an element is to be deleted from an array then all the elements 
after the deleted element are to be shifted one position towards the left. Another 
drawback of array representation is that, because of static nature of array, maximum size 
of the list i.e. maximum number of elements to be stored in list must be known in 
advance. 

Because of these limitations of the array, another efficient way which is generally used 
for maintaining the lists is called linked representation. In linked representation, each 
element of the list contains a link to the next element in the list. So, in linked 
representation, there is no restriction on the list elements to occupy contiguous locations 
in the memory. This approach is very efficient for maintaining the lists into the computer 
memory. 

In this chapter, first of all we will define the linked list, and then various operations that 
can be performed on the linked list will be discussed. After that some special types of the 
linked lists and operations associated with them will also be discussed. At last, 
applications of linked list will be discussed. 

3*2 Linked List 

A hnked list can be defined as the linear collection of elements where each element is 

inatlV 0 ? n ° de and the linear order between elements is given by the means of pointers 
d ivi T A a . sec l uen tial memory locations. In linked list or one-way list, each node is 

part L'T t ? r0 pa ?’ ^ irst P 01 * tb® no£ * e contain the element itself and the second 
wmcn is termed as next field or pointer field contains the address of the next node in 
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A Simplified Approach to Dat a Structures .. — 

x- • address of the next node of the linked list in the 

^p^oTTe^eTsta. Indeed lists do not store the list element at contiguous 
mmory Cations as is the case of arrays. Thus, to reach at next element >n the list, we 
need the memory address of that node where it is stored in the computer memory. 

The structure of the node is shown below: 



Info 


Info Node Next 

Structure of a Node 

While maintaining the list into the memory, a pointer variable Begin is used which 
contains the address of the first node in the linked list. The Next field of the last node of 
the list contains the Null value which indicates the end of the list. 

local! the n °? es of the linked list are not stored at contiguous memory 
list of roll numhpre ° ff may ^ Spread at different locations of the memory. Considers I 

be represented *" 4 °‘ 2 ’ 4 °° 2 ' 4 ° 14 ’ 4 ° 18 ’ 4009) ’ W i 

students are stored in memorv at Hiffr ^ f n ° des re P resentin g the roll numbers of the 
m mem ory at different locations as shown in figure: 

^_ 

f 4018 I 112381 I 


4014 1024 


jW09 | Niilf| 
11238 


20976 


4002 | 5096 
14764 


4012 | 14764 
20976 


node° Se ’ *" lrst node co ,** read ° Ver t * le w * 10 * e memory area 

number 40 1 * 11 ? r °^ member 4 * 00 ? r °^ num ber 4012 is stored at address 20976, sect 
and fifth . at ad dress 5096 f n „ 11 Stored at addre ss 14764, third node containing 
diagram abovA C « nta * n * n 8 roll node conta ining roll number 4018 at address W 

^ scattered n °des contain- ^ er 4009 at address 11238. As it is evident from, 

^se nodes is the linic«H ? 8 , e ^ ements are not placed one after the other . 

attained bv lint- 1St 8 ^ near data structure because the linear ord 

mg these nodes using the Next field of each node— Jj 
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Linked List 


Here, 

Next part of l 4t node holds the address of 2 nd node i.e. 14764 
Next part of 2 nd node holds the address of 3 rd node i.e. 5096 
Next part of 3 rd node holds the address of 4 th node i.e. 1024 
Next part of 4 th node holds the address of 5 th node i.e. 11238 
Next part of 5 th node holds Null because it is the last node 

The address of 1 st node is held in a special pointer variable (a variable that can hold the 
address) known as Begin. Here, the variable Begin will hold the address 20976. 

Instead of remembering the addresses of the nodes, we use a diagrammatical approach to 
represent the linked list. That is, instead of writing the address, we use an arrow to 
represent the link of one node with the other as shown below: 



\ Links between the nodes in the memory 


Following is the linear representation of the above scattered representation: 


4012| 40021 ~^-» l4014i ~^ -» j4018| —|— » |40O9| Nul| 

20976 14764 5096 1024 11238 

Linked list of roll numbers of 5 students 

The linked list is categorized into 4 types as follows: 

* Singular or One-way Linked List 

* Doubly or Two-way Linked List 
Circular Linked List 

* Header Linked List 
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3.3 One-way Linked List 


ne-wayij . linked list In this linked list, each node has 

One-way Med list is also known! is« J* Lj which hold the element and die 2 

1st L pans. The l“ P art nex t node. The address of l“node 

part is known as Next part which ho , anc j t he Next part of last node 

l stored in a special variable known as Begin ana me y 

contains Null indicating the end of the linked list. For examp , 


( Begin ) 

I- |4012l 


4002 


4014 


4018 


1j-» |4009| Nul] 


Linked list of Roll numbers of 5 students 


Operations performed on One-way Linked List 

There are various operations that can be applied on the linked list, 

Traversing a linked list 
Searching an element in the linked list 
Inserting an element in the linked list 

Deleting an element from the linked list 
Copying a linked list 

Merging two linked lists 
Splitting a linked list into two or more ]j s j s 
H «e, we will discuss traversal war u- . 

, . c ln & insertion, and deletion operations in detail- 

3 -3-l Traversal ftfis-._ 


—me 

^. r "r,!;' LU,ked Li » 

,n /o which lni , each n °de of Iinv°^ e i- St0red in the list pointer variable Begi*' 

contains the addre” 18 the ele ment itself 1S j has two parts. The first part is 
v&tiahu n_s oftiAvi — « ^lf and the GA/-A1./1 f A wa^A4*V*Ad tlritH 


mentioned uress of h s i« ' ~ 1101 w nicn is maintained into tne raww*; - * 
,n /o which cnn^ eachn °de of Iinv°^ e i- St0red in the list pointer variable 
contains the addr ^” 8 the ele ment itself 1 S j has two parts. The first part is 
Va bable Pointer* ?^ next node in th secon d part is referred with N *' 

««mJZ whieh t I hile “ 8 1116 " 1 

• Traversino - 1 “ le address of the current node. | 

lfBe din =- jy ** Way linked list to print the elements of the lin ** 1 

x>*i . Then 

Exit L,nked List is Empty” 
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[End If] 

Step 2: Set Pointer = Begin 
Step 3: Repeat While Pointer * Null 

a. Print: Pointer -> /n/o 

b. Assign Pointer = Pointer -> Next 
[End Loop] 

Step 4: Exit 


Explanation:~ " -- - 

to the above algorithm for traversing the linked list, the step 1 is used to check if the 
given linked list is empty. If it is empty, print a message and exit. The linked list is empty 
it the starting address of the linked list is Null. Step 2 is executed if the linked list is non 
empty, ariable Pointer is assigned address of the first node of the list. Now, within the 
loop, Info part of the currently traversed node is processed i.e. in this case, printing the 
element and Pointer is assigned with the address of the next node in the list. Now, the 
e ement in the 2 node will be processed and Pointer will be assigned with the address 
°aa neXt n0( * e no( * e# These steps of processing elements and assigning the I 

address of next node to the Pointer will be repeated until we come across the Null I 
_entry in the Next part of a node. I 


Now, let us traverse the linked list to find the largest element in the list. 

^Algorithm: Traversing a one-way linked list to find the largest element in the list. 
Stepl: If Begin = Null Then 


Print “Linked List is Empty” 

Exit 
[End If] 

Step 2: Set Max = Begin -> Info and Pointer = Begin -* Next 
Step 3: Repeat While Pointer * Null 


Step 4 ; 
Step 5 ; 


If Pointer -»Info > Max Then 

Set Max = Pointer -* Info 

[End If] 

Set Pointer — Pointer -* Next 
[End loop] 

Print: Max 
Exit 
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^Simplified 

S '“ rCh '" g ^ ^ (LineM S— - »S» ^“Pr 

In Chapter 2, two s ®“° A in deta u. But in hj*® 1 “' yj e canno t apply t> inar y sef 

have already been to ^^3 of using do not occupy contiguc 

which is one . . . ^ as the elements of a middle element in the link 

,is ’ “ ^ 

list Therefore, only linear search can ff 

unS0Ited ' ii«t from beeinning and compare 

to case of unsorted linked list, we traverse the hat from begi g 

dements stored in each node with the denied element (say Data), to ^ 

match is found then the address of the node is returned. Otherwise we proce 

next node in the list until we get the desired element Data 01 we reach the e 

indicating the unsuccessful search. 


/ 


UlUlVVtaiia^ ***■•“ --—- 

Algorithm: To find the location of a desired element 'Data' in an unsorted 111 
list. 


Step 1: 


Step 2: 
Step 3: 


If Begin = Null Then 

Print: “Linked List is Empty” 

Exit 
[End If] 

Set Pointer = Begin 

Repeat While Pointer * NuU 

K Pointer -, n/o . 0ataThen 

Pnnt: “Element is found at 
Exit 


address”: Pointer 


Else 


Step 4 *. 

Step 5 . 


tend Li 


[End ^ P ° lnters p olnter^ Next 


-OOP] 


Print: “Ew 

Exi, mem »»t fou» d in i inked List „ 
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Explanation: 

In the 1 st step, condition for empty linked list is checked. If the linked list is empty, a 
message is printed and exited from the program. 

Step 2 is executed if the linked list is not empty and the variable Pointer is assigned the 
address of l rt node of the list. 

In step 3, the loop is executed and within the loop, if Info part of node Pointer is equal 

to desired element Data then we print a message and exit from the program. Otherwise, 
we assign the address of next node to the Pointer variable. These steps will be repeated 
until the Pointer variable reaches at the next part of the last node i.e. its value 
becomes Null. 

If the value of the variable Pointer becomes Null then control comes out of loop and it 
is evident that the desired element Data is not present in the linked list. 


Suppose the linked list in which a desired element is to be searched is sorted in ascending 
order. Now, we will find the location of the given element Data by traversing the list 
starting from the beginning. But this time we can stop the search if during the search, we 
encounter a node in which the element stored is larger than the desired element Data . 


Algorithm: To find the location of a desired element 'Data' into a sorted (in 
✓''ascending order) linked list. 

Step 1: If Begin = Null Then 

Print “Linked List is Empty” 

Exit 
[End If] 

Sc P 2: Set Pointer ■» Begin 
Step 3: Repeat While Pointer * Null 

If Pointer -* Inf o — Data Then 

Print: “Desired element is found at address”: Pointer 
Exit 

Else If Pointer Info > Data Then 

Print: “Desired element is not present in the linked list” 

Exit 

Else 

Set Pointer = Pointer -> Next 
[End If] 

[End Loop] 
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Step 5: Exit 

3 , 3.3 Memory Allocation and Deallocation 

Before discussing insertion and deletion into the linked list, it *nccc«uy * 
about the memory allocation and deallocation for insertion and deletion operations 
respectively. To insert an element into the linked list, the first requirement is to get a free 
node. On the other hand, in case of deletion of a node from the linked list, it is desirable 
to return the memory taken by deleted node for its reusability in future requirements. 

The task of obtaining an empty node for insertion and returning free node after deletion is 
accomplished by maintaining a separate list of free nodes that begins with pointer Free 
which points to the first available free node. This separate list of nodes is treated as free 
memory pool. During insertion into the linked list, a free node can be taken from the free 
memory pool. Similarly, when a node is deleted from the linked list, this deleted node can 
e deallocated i.e. sent to the free memory pool for future requirements. 

(Usf conteinin^fr 10 ^ ^ t0 \ be inserted into the linked list then first of all, free storage list 

? ecked for the availability of a free node. If the node is 

list will now point to the^Y^ ^ nJced ^ st an d the pointer Free of the free storage 

storage list then this situation STh^ 6 However > if there is no free node in the free 
as overflow. n lcate d by Free = Null and this condition is known 

A. similar approach can be used f 

linked list. This deleted node is ini ^ tl ^ rn ^ n S a node for reuse when it is deleted from 3 
eginning of the free storage list Xf 6 6 , as a ^" irst n °de of the free storage list i.e. at the 
***"?»% added “Ode The oners.* he ?° inter Free of free storage list will po" 1 ' 
e t e free storage list i s ill U strnt^H° n °f ® ett ' n 8 the free node from and returning 

nustrated m the figures shown below: 



New * Free 
Free ■ Free-►Next 


de from the Free Storage List (Allocation) 


3 



, " enl< -'»f.No d e 


Pointer-#Ne*t 
Fr»<» ■ Pointer, 



Int ° the Free Storage List (Deallocation) 
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Linked List 


3.3.4 insertion in Linked List 

While inserting an element into a linked list, the first requirement is to get a free node 
from the free storage list. Once the space for the new node becomes available, the 
element to be inserted is placed into the Info part of the node and pointers are set to add 
the new node at the desired insertion position of the linked list. The new node can be 

inserted, 

• At the beginning of the linked list 

• At the end of the linked list 

• At a particular position in the linked list 

• In the sorted linked list 

Let us discuss the insertion of a new element in each case one by one. 


3.3.4.1 Insertion at the Beginning of the Linked List 

While inserting the new node at the beginning of linked list, first of all we need to check 
whether the linked list is initially empty or not. If the linked list is initially empty en we 
will store the Null value in the Next part of new node to be inserted an tea ess o 
the new node will be stored into the list pointer variable Begin as shown be ow. 



An Empty Linked List 


Insertion of a Node 
into an Empty Linked List 


But, if the linked list contains one or more nodes, then the address stored in 
pointer variable Begin will be stored into the Next part of the new node an 
of the new node will be stored into the list pointer Begin as shown e ow. 



New 


Linked List after the insertion of New Node 
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MlmpliM Approach to P i h ^ ^ ^ ^ ^ 

Algorithm: Inserts * new elemen 

** ^ ^ F Tnn“ “Overflow No free space available for insertion” 

Exit 
[End If] 

Allocate space to node New 
(Set New = Free And Free = Free -> N 
Set New -* Info = Data 
Set New ^ Next = Begin And Begin = New 
Exit 


Step 2: 



Explanation: 


In the above algorithm, step 1 is used to check for the availability of empty node in free 

memory pool (free storage list). If no free space is available then an error message is 
printed and exited from the program. 

one^emntvTn^ 6 ^ ^*5? Sp&Ce * s ava ^ a ^^ e i n the free storage list. In this step, we get 
om e ee storage list and allocate that node to the linked list. 

In step 3, we put the element Data in the Info part of this new allocated node. 

-~ we lnsert thls New node at the beginning of the linked list, _ 

/ the End ° f * he unked List 

list is initially empty or not. ‘inkedfirstwe will check whether the linked 

‘ nsert ion of a node at tho h* ^ ‘ s initially empty then this case is same 
becin* 1 ' ^ Ut ’ d “ st is not emnt 6 ^? 11111 ^ ‘i st as discussed in the precedingse 
node w" 8 * we reachS ** We wil1 traverse the entire linked list 

SekTr 11 /? 16 “* »*Coft"° de of ‘inked list. On reaching at the M 
an d the N ext part of l* 6 new node into the Next part of the last node of** 
(gjj) ne w node will be set to Null. 


Ins e**ton 


~12 | -4 -» { 19 | Nu»| - 

Pointer 


°Inode 'New' at 


\j-TT0 


the end of the Linked List 
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Algorithm: Insertion of a new element ' Data' at the end of the linked list. 

Step 1: If Free = Null Then 

Print: “Overflow: No free space available for insertion” 

Exit 


[End If] 

Step 2: Allocate space to node New 

Set New = Free And Free = Free Next 
Step 3: Set New -> Info = Data, New -> Next = Null 
Step 4: If Begin = Null Then 
Begin = New 
Exit 



% 



[End If] 

Step 5: 

Set Pointer = Begin 

Step 6: 

Repeat While Pointer Next =£ Null * 


Set Pointer = Pointer -> Next* 


[End Loop] 

Step 7 

Set Pointer -* Next = New 

Step 8: 

Exit • ' 


Explanation: 

In the above algorithm, 1 st step is used to check for the free space in the free storage list. 
If no free space is available then an error message is printed and exited from the program. 

Step 2 will be executed if the free space is available in the free storage list. In this step, 
we allocate a node to the linked list and prepare this node by putting the element Data in 
•V° part and Null in the Next part of the node. Null value is set to the Next part 
th w a ^ ocated node because this node will become the last node of the linked list and 
e ™ ext part of the last node of the linked list contains Null. 

thS tlnl 1 ° heck whether the linked list contains node or not. If linked list is empty 
New node is set as the first node of the linked list and we exit from the program. 

on%ode 4 In S .V S T empty then ” step 5 ’ we set a variable Pointer with the address 
"ode. After tu- 6 ’ We exacute a loop usin 8 the Pointer variable to reach at the last 

^e 8 h ! XaCUt :° n of '°, op ’ the variable wU1 hol<i address of last node and 
'— -ll he Next part of last node with the address of new node New. 


m 
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. TO ach to nate Structural 

of the Linked Lilt 

vj.43 Insertio a par ticular node, we will locate the 

For inserting a new node into a juiked the new node . Two cases arise here - 

position of the node after which we wan will be inserted after it Second, the 

First if *e desired node is found, the The i„ se rtion is accomplished by 

desired position is not found in the giv u til we find the desired position 

using a pointer variable Pointer and ttaversurg the hsttmnii ^ 

orrLhatthe end of the linked list (i.e. we do not find the ^ 
insertion to take place). Thus, if we reach at the end ot the imuo11 
desired position, the new node will not be inserted as mentioned in the sec 




■CEQ4ZI34ZI 


12 


Null- 


Pointer 


Item |Null 
New 


New -►Next - Pointer-►'Next 
Pointer-►Next ■ New 


I_- 

Insertion of a node ‘New’ after a particular node (containing element 12) 
l-L-L-3 \ I —)r ^, J 12 | NuIIl 

Poin ^ 

^•►fTtem | ^ 

New 


Insertion of a node ‘New’ aft ~ ' 

Algorithm: Insertion of a «i ** * particular node (containing element 7) 
U,t ** element after a specific element Data' i> 

StePl ' If Free > NUUTW 


1 — Mew 

New-►Next - Pointer-*Nexi 
Pointer-»>Next - New 


m 


int - “Overflow No 

Exit 6 Space bailable for insertion” 

[End If) 

Step 2: Set Pointer = Begin 

Repeat While Pointer * N ,„, 

Set Pointer s* p nt ^Nt) Pointer r * n #/r 
[End Loop) ° lnUr - Next ‘ nf ° * DM * 

It Pointer - Null Then 

Print: “The node containing elem 

*«■ 1. no, .o in^» " 


Step 3: 


Step 4: 
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not possible.” 


Else 


Allocate space to node New 


Set New = Free, Free = Free -> Next, New -»Info = /tern 
Set Atew -► = Pointer -► lVe*t, 

Set Pointer —► Next — New 
[End If] ' 

Step 5: Exit 


Explanation: I 

In this algorithm, step 1 is used to check for the free space in the free storage list. An I 
error message is displayed and exited from the program if there is no free space available. I 
In Step 2, we set a variable Pointer with the address of 1 st node and we execute a loop I 
using this Pointer variable to reach at the node which contains the element Data or we I 
reach at the end of the linked list. We come out of the loop whenever any one of these I 
two conditions gets true. Outside the loop in step 4, we check, with which condition we I 
come out of the loop. If the variable Pointer = Null, this means we have reached at I 
the end of the linked list indicating that we did not get the node which contains the I 
element Data. So, we will not insert the element in the linked list. An error message is 1 
displayed and exit from the program. If Pointer * Null, this mean Pointer holds the 1 
address of the node which contains the element Data. A new node is allocated and the I 
element Item is put into the Info part of this allocated node. We insert the new node I 
after the node containing element Data. 1 

3.3.4.4 Insertion in a Sorted Linked List 

To insert an element into a sorted linked list, we need to find the position of the node 
after which new node has to be inserted. Suppose, the elements of a given linked list are 
sorted in ascending order and we want to insert a new element Item into the linked list 
so that after insertion, the linked list is again in ascending order. We start comparing the 
new element (to be inserted) Item with the first element of the linked list. If the Item is 
smaller than the first element then the new node will be inserted at the first position of the 
linked list. Otherwise, the list will be traversed to find the position of the node after 
which the new node is to be inserted. While traversing the list, if we do not find any node 
whose element is larger than the element Item then this new node will be inserted at the 
end of the linked list. After finding the exact position for the new node, we insert the 
node at that position. Following figure illustrates the process of insertion in sorted linked 
list. 


77 


Scanned by CamScanner 



A Simplified Appruam w --— 



Insertion of a Node into a Sorted Linked List 
Algorithm: Insertion of a new element 'Item' into a sorted linked list. 
Step 1: If Begin = Null Then 

Allocate space to node New 

Set New = Free And Free = Free Next 
Set New -»Info = Item 
Set New -4 Next = Begin And Begin = New 


Step 2: 


Step 3: 
Step 4: 


Step 5: 


Step 6: 


Step 7; 


Next Begin And Begin = New 


[End If] 

If/tern < Begin -» Info Then 
Allocate space to node New 

SetAtov = Free And Free = Free Next 
Set New -> info = item 
Set New 
Exit 
[End If] 

Set Potnterl = Begin An d Pointer2 — ft , 

Repeat While Pointer! * NuIIaIT,~ ^ NeXt 
Set Potnterl = Pointer2 A^d P T > P ° inter2 In f° 

End Loop] And Pointed = Polnter2 _ Next 

Free = Null Then 
Print: “No Free . 

Pot possible” r lnsertl °n, Allocation of <, 

Exit n s P ace to node New is 

[End If] 

ZZT P T odtNew 

Se'Aeiv -* inf Q Next 


Free 
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Step 8: If Pointer! = Null Then 

Set Pointerl -> Next = New And New -* A^ext 

Else 

Set New -» Next = Pointerl -> Next 
Set Pointerl -> Next = New 
[End If] 

Step 9: Exit 


= Null 


Explanation: ~ 

In the first step, the given linked list is checked whether it is empty or not. If linked list is 
empty then the given element Item is inserted as the first node of the list. For inserting 
the given element Item as first node in the list, memory is allocated to node New and 
this node is inserted as the first node after putting the element Item in its Info part. In 
step 2, it is checked, if the element to be inserted into list is smaller than the element of 
the first node of the list then the new node New is inserted as first node in the linked list. 

In the third step, two variables Pointerl and Pointer2 are-initialized by storing the 
address of first and second node in them respectively. These two pointer variables are 
taken to locate the appropriate position for the element Item to be inserted into the 
linked list. In step 4, loop is executed to find address of node after which the new element 
Item can be inserted or we reach at the end of the list indicating that the new node New 
will be inserted at the end of the linked list. Here, the node New will be inserted after the 
node whose address is in variable Pointerl. 

In the step 5 free storage list is checked for the availability of free node. If free space js 

Sat A s s £ a swrawi sssi 

depending upon the situation resulted due to step 4. 

3.3.5 Deletion from Linked List 

The deletion operation can also be performed at varions positions in the hnke tab 
. Deleting a node at the beginning of the linked list 

. Deleting a node at the end ofthe linked Its 

. Deleting a particular node in the hn e is morv space occupied by 

in any of dre above three cases.^^C'S^-^ 
the deleted node will be returned to the free S 
the above mentioned cases one by one. 
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a cimolified Appro ach to Data St ructures 

A Simplified^-- * . nning of the Linked List — 

i ^ f 1 Deleting a Node at the Beginning ! 

3.3.5.1 ueieung jg a very simple operation which can L 

Deletion of a node at the beginning / iable Begin. Now, Begin will point to the I 

accomplished by changmgthe ied by the deleted node is returned to the (,« 

o'" 1 node in the linked list. The space ocoup 

Lot 


storage list, 




1 


12 


Null 


QtatT y p \ I J I I ■* 1 

Deletion of a Node from the Beginning of the Linked List 

Algorithm: Deletion of the first node of the linked list. 

Step 1: If Begin = Null Then 

Print: “Linked list is already empty” 

Exit 
[End If] 

Step 2: Set Item = Begin -> Info And Pos = Begin 
Step 3: Set Begin = Begin -» Next 

//Deallocate memory of the node Pos 
Step 4: Set Pos -* Next = Free And Free — Pos 
Step 5: Exit 


Explanation: 

Step 1 is used to print an error message and exit from the program if the linked list is 
empty. 

Step 2 is used to store the address of the 1 st node (node to be deleted) to a variable Pos so 
that the memory held by this variable can be deallocated and pooled to free storage list. 

of2 Pnd3 ntde Sed '° ddete 1116 1, n ° de fr ° m 1116 linked Hst by assi « nin 8 Begin, the address 
Step 4 is used to insert the deleted node (havi ng address Pos) to the free storage list. 

3.3.5.2 Deleting a node at the End of the Linked List 

linked list for findi!ig°the adTes^ofthe" Drtfrf liSt ’ necessar y t0 traverse the entire 

second last node. After finding the address C f node of 1,16 last node i.e. address of 

nttmg the address of the second last node, we will store the 
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Deletion of a node from the end of linked list (having only one node) 


After removing the last node from the linked list, the removed node will be returned to 
the free storage list for reusability. 

Algorithm: Deleting the last node of the linked list. 

Step 1: If Begin = Null Then 

Print: “Linked List is Empty” 

Exit 

[End If] . 

Step 2: If Begin - Next = Null Then //Linked List is having only one node 

Set Data = Begins Info 
Deallocate memory held by Begin 
(Begin-* Next = Free And Free = 

Set Begin = Null 


Begin) 

//Indicating Empty Linked List 
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Step 3: 
Step 4: 


Step 5: 
Step 6: 
Step 7: 

Step 8: 


Exit 

SetPolnterl = Begin And Pointed = Begins Next 
Repeat While Pointer! -> Next * Null 

Set Pointerl = Polnter2 And Pointer2 = Polnter2 

[End Loop] 

Set Pointerl -> Next = Pointerl -> Next 

Set Data = Pointerl -* Info 

Deallocate memory held by Pointerl 

(.Pointerl -> Next = Free And Free = Pointerl ) 

Exit 


We# 


Explanation: 

Step 1 is used for the condition of empty linked list. If linked list is empty, print an error 
message and exit from the program. 

Step 2 is used if linked list has only one node. Thus, this only node is deleted and stored 
back to free storage list and variable Begin is set to Null and exit from the program. 

Step 3 and 4 are used to reach at the last node (node to be deleted) and second last node. 
After step 4, the last node’s address will be in Pointerl variable and the address of 2 nd 
last node will be in Pointerl variable. 

St e P 5 and step 6 are performed to exchange the pointers so that the Next part of 2 nd last 
node contains Null and last node is deleted from the given linked list. 

spice 7 1S US6d t0 mSert the delet6d n ° de ( having address Pointer1) to the free storage 



3.3.S.3 Deleting a Particular node from the Linked List 

the preceding node onh^node^o be'delete^T 1 ' 8 '’ the f ‘ rSt task is t0 find the address of 
list from the beginning and comp * If f ° aCCOm P lish ««■ ‘ask, traverse the linked 
wtth the given item. Two poSrtabl J ’SZT* S,0red in In f° P** °f each node 

preceding "'h *“* for l° ca ting the address of th^^A 30(1 Pointer2 will be used while 
p ing node. Consider the following linked nit *° be deleted and address of i» 

8 kCd llst as shown below: 


■H 

0 

Q 

H 

0 

n 

H 

0 

rq 

u 

0 

1-1 


r— 




i i 

LZj 

n 

Ld 

H 

38 

Null 
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Pm -Begin 
[ Begin ■ Begin Next 
Pm “►Next-Free 
Free - Pm I 


Deleting an element' Item ' (=25) which is in l ,l node 



Poinfcerl *♦ N«t * Pointei2 -►Next 
Points-►Next« Five 
Piw- Pointer* 


Deleting an element ' Item ' (=42) which is any node except l'‘node 

Algorithm: Deleting a particular node containing the given element 'Item! from the 
linked list. 

Step 1: If Begin = Null Then 

Print: “Linked List is Empty” 

Exit 
[End If] 

Step 2: If Begins Info = Item Then //Deleting the 1 st node of the 

Linked List 


Set Pos = Begin 

Set Begin = Begin -> Next 

Pos -»Next = Free And Free = Pos //Deallocate memory 

held by Pos 


An 
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a aimniified App roach to Data Structures - 

Exit 
[End If] 

Step 3: Set Polnterl = Begin And Polnterl = Begin Next 
Step 4: Repeat While Pointer! * Null AND Pointer 2 -* Info * Item 

Set Pointerl = Pointer! And Pointer! = Pointer!-* Next 
[End Loop] 

Step 5: If Pointer! = Null Then 

Print: “Node containing element Item not found” 


Step 5: 


Else 

Set Polnterl -> Next = Pointer! -> Next 
[End If] 

Step 6: Deallocate memory held by Pointer 2 

(Set Pointer! -> Next = Free And Free = Pointer!) 

Step 7: Exit 

1 Explanation: ~ 

1 program 8 USeC * t0 ^ nt &n eiTOr messa S e if the linked list is empty and exit from the 

nZl l r„ aoi f is 6(1113110 Hem ln ,his case 1116 Be t 

I storage list. node ^ e 9in -> Next) and the l* 1 node is sent to free 

1 givento the variabl ^Pointer"^ address of lS ‘ node and address of 2 nd node is 

1 hsV 6 ^ atthe end ofthe linkedlisTLdicah 01 ^ * he node containin 8 element Item ofj 
Ust - St mdlcatln « tl ^at the element Item is not found in & 

I ®tep 5 is used to print 

--■ -- - -— 

l free storapo i;„ t | 
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3 • 3 '6 Copytog a Linked List into Other Linked List 

For spying this given linked 

source list will be copied. Initially^ f ° r *' lis ‘ “ »** 

we will traverse the entire 

contents at the each node to the new target list. 8 nnmS t0 016 end * ,y C0 PJ™8 tlle 


sBeginT 


■-► 8 

-“*> 6 

3 ‘ 

2 Null 

A Linked List which is 

Begirt^ 

required to be Copied 

1 -► 8 

mm + 6 

”► 3 

2 Null 


Copied Linked List 

Algorithm: Copying the elements of a linked list to another linked list. 
Stepl: IfBeginl = Null Then 

Print: “Source List is Empty “ 

Exit 


[End If] 

Step 2: Set Begin2 = Null 
Step 3: If Free = NullThen 

Print: “Free Space not Available” 
Exit 

Else 


Allocate memory to the node New 

Set New = Free And Free = Free -> Next 


[End If] 

Step 4: Set New Info - Beginl Info And New -* Next = Null 
Step 5: Set Begin2 = New 

Step 6: Set Polnterl — Beginl -* Next And Polnter2 = Begln2 
Step 7: Repeat While Polnterl * Null AND Free ± Null 
a. Allocate memory to the node New 
(New = Free And Free = Free-* Next) 


85 


Scanned by CamScanner 






















. .. n a ta "tr '' f " re8 I 

a swufledA£E££2i^— rT7Irt*^i -* lnf0 And Arw * Nm *m 
— \set ^ ■* 'f°' t = \e* 1 

c. Set PoM* 2 -* w gr t _ *«*£ And Po<n«er2 = New i 

& Set Pointed ~ 0 I 

[End Loop] 

o. if pointer 1 * ^ 711611 t „ 1 

Step8 ' prfat-Ust Copied Successfully j 

Else - a „ Available to perform Copy operation": j 

Print: “Not Enough space Ava 

[End If] j 

Step 9: Exit ____ 

Explanation: program execution if linked list ii 

Step 1 is used to print a ” e ™ r “^f ist is initializedwith pointer variable Begin!. laf 
empty. In step 2, a new empty link .. . memory to a node New. In step k 

riS! 

Pointer 1 is set to address of 2 nd node of the 1 st list (as 1 st node of 1 list has been copi 
in step 4 and 5) and Pointer 2 is set to the address of 2 nd list i.e. Begtnl. Step 7 is us 
to execute a loop till the pointer variable Pointerl reaches the Next part of last node 
l 8t list (i.e. Pointerl = Null) or the free storage list becomes empty(i.e. no free spa 
is available in free storage list). Within the loop, every next node from 1 8t list is copi 
and concatenated into the 2 nd list. The process of copying the list is stopped if free stora 
list becomes empty or pointer to first list becomes Null i.e. 1 st list is finished. 




»> v 

1 



I 


3.3.7 Merging Two Linked Lists 

sinde a PP^ ca ^ ons where there is a need to merge two or more lists into I 

list The lists tobeSr putting the dements of two or more lists into on 

an idea of merging^ two sorLlidlS *" * 

OSS)—►Ts | 4-JiTl Um—i i—i—i 


32 Null 


a sorted Linked List with 4 Nodes 


Jjegin 


A Sorted Linked Lis, with 3 Nodes 


20 Null 
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Begin 


M 


8 


10 


12 


3-* h + »n°n-*F 


Linked List after the merging the two Sorted Linked Lists 
Algorithm: Merging two sorted linked lists into a single sorted list 
Step 1: If Begin! = Null OR Begin! = Null Then 
Print “One of the given linked lists is empty “ 

Exit 
[End If] 

If Free = Null Then 

Print “No Free space is not available” 

Exit 


Step 2: 


Null 


Else 

//Allocate memory to node New 

Set New = Free And Free = Free -* Next 


Step 3: 
Step 4: 


Step 5 
Step 6 
Step 7 


[End If] 

Set Begin = Null 

If Beginl -* Info > = Begin 2 -> Info Then 

Set New -> Info = Begin! -* Info And New -+ Next - Null 
Set Pointerl- Beginl And Pointer! - Begin! -* Next 

p| qg 

Set New-* Info = Beginl * Info And New * Next = Null 
Set Pointerl = Beginl* Next And Pointer! = Begin2 

[End If] 

Set Begin = Atew And Pointer = New 

Repeat Steps 7 and 8 While Pointerl * Null AND Pointer! * Null 

If Free = Null Then 

Print “No Free space available 


Exit 


Else 

//Allocate memory to node New 
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Step 8* 


,. fied ApproachtoDataSWC^ -- -J 

irPoinMrl -»/»/° 2 Polnter2 -* Jn/oThen ' 

SctHew* Info = PoMer 2 -+info 

Set New-* Next = , 

Set Pointer -* Next = A^cw 

Set Pointer = New And Pointer2 = Pointer!-* Next 


Set Nett- - /n/o = Potnterl - /n/o 1 

Set New -> Next = Null 1 

Set Pointer -> Next = New 

Set Pointer — New And Pointer 1 = P o inter 1 Next j 

[End If] 

[End Loop] 

Step 9: If Pointerl = Null And Free =£ Null Then 
Repeat While Pointer! * Null 
//Allocate memory node New 

a. Set New = Free And Free = Free -» Next 

b. Set New -» Info = Pointer! -* Info And New -» Next = Null 

c. Set Pointer -► Next = New 

d. Set Pointer = New And Pointer! = Pointer! -> Next 
[End Loop] 

Else 

Repeat While Potnterl * Null 

HAllocate memory node New 

I'ZT 

o. Set New -4 /n/o = p ft / 

«• Set Pointer - We xt = /n/0 Next m ^ 

t d ' Sct p °lnter a jy eu , A . D 
I ° ntcrl 38 p otnterl -> Next 


W 
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[End Loop] 

[End If] 

Step 10: If Pointer 1 = Null AND Pointer! = Null Then 
Print: The given linked lists merged successfully” 

Else 

Print: “Not Enough space “ 

[End If] 

Step 11: Exit 


Explanation: 

l 4t step is used to check, if 1 st list or 2 nd list is empty then merging is not possible and 
procedure is stopped. In 2 nd step, if free storage list is empty then stop the execution as no 
free space is available for the 3 rd list. In case, free storage list is available then memory is 
allocated to a node New. A pointer variable Begin (indicating the address of 3 rd list) is 
set to Null (as 3 rd list is yet having no node). In step 4, if element in 1“ node of 1 st list is 
larger than or equal to element in 1 st node of 2 nd list then, element of 2 nd node is copied in 
Info part of node New and two variables Pointer 1 and Pointer2 are initialized. 

Pointer 1 is initialized to address of 1 st list and Pointer 2 is initialized to address of 2 nd 
list. 

In case, element in l 9t node of l 8t list is smaller than element in 1 st node of 2 nd list then 
element of 1 st node is copied in Info part of node New and the variable P o inter 1 is 
initialized to address of 2 nd node of 1 st list and Pointer 2 is initialized to address of 2 n 

list. 

Step 5 is used to initialize the third list in which the node New is copied as the 1“ node 
and a pointer variable Pointer is initialized to address of this 1 node New Step 6 is 
used to execute the loop until 1“ list or 2* list is finished. Within the loop, firstly, the free 
storage list is checked for allocating memory to node New. This new node is pttpm&by 
comparing the element in current node of both the is (porn y 
and Pointer!) and this node New is concatenated to third list whose last node s 

pointed by Pointer. Loop in step 6 breaks if either the ist « mis ®ncatenated 

finished. So, in step 9, if 1“ list is finished then all the nodes of 2 Ust are 
in 3 rd list until free storage list is available. Similarly, 1 in « s 

nodes of 1“ list are concatenated in 3 ri list until free storage space .s avaUable ^Step m ,s 
used to check if pointer variable Polrtterl(po.ntmg to cmrent node of 1«0 ^d 
Polnter2(pointing to 2”“ list) both becomes Null. Otherwise, it is definite that me 

space in free storage list is not available. 
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3.3.8 Splitting a Linked List into Two Linked Lists 

Suppose we have a linked list which we want to split into two linked lists of 1 

size. To accomplish this task, first of all we will traverse the list to count the tot^ °H 

of nodes in it, then we will find the address of the f-) th and (- + i 

\ 2 j u \ 2 + L ) ttl node. After 
determining these addresses we will store Null value in the next part of the th ^ 

and address of the +1) th node will be stored in the new list n • J 

variable Begin!. Now, our list is splitted into two lists of sizes - and (n - -) with r 

na* . HP1. _ 1 * A i ' a 2/ 


pointers and Begin! respectively. The split operation performed on die M to! 
list will divide the list into two lists which are shown in figures below: * 



14 


13 


27 


A Linked List to be Splitted into Two Linked Lists 


19 


Mi 



14 


7 | Null 


The 1* Linked List Created after the Split 

JJegin 

i 



19 


The 2 nd Linked List Created after the Split 


Null 


'Begin' and tW0 Unked Usts with list pointer variable* 


Step 1: 


If Begin = Null 

“Splitting cannot be performed on empty list” 


[End If] 

Set Pointer = Begin And Count = o 
Repeat Steps 4 and 5 While Pointer * NuU 
Set Count = Count + 1 

Step 6: Set Mid - Integer 


Step 2 
Step 3 
Step 4 
Steps 
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Step 7: SetBe#in2 = Null And Pointer = Begin And l - 1 
Step 8: Repeat Step 9 While i < Mid 
Step 9: Set Pointer = Pointer -* Next 

Seti = i + 1 
[End Loop] 

Step 10: Set Begin 2 = Pointer -+ Next And Pointer jVe*t = Null 
Step 11: Exit 

Explanation: 

In step 1, if the list to be splitted is empty then execution is stopped as list to be splitted 
does not has any node. In 2 nd step, the variable Pointer is initialized to address of 1 st 
node of the list and a variable count is set to 0. Loop is executed in step 3 for counting 
the total number of nodes in the list. In step 6, a variable Mid is set to the value of one 
half the total number of nodes in the list. 

In step 7, a variable Begin 2 is initialized to Null indicating the empty 2 nd list. A 
variable Pointer is initialized to 1 st node of the given list to carry on the splitting 
operation. A variable iis to set to value 1. In step 8, loop is executed until value of i is 
less than Mid (half the total number of nodes in the list) 

Within the loop, Pointer variable is set to next node in each step. After the complete 
execution of loop, Pointer variable holds the address of middle node of the list. 
Address of next to middle node (Pointer -> Next) is stored in variable Begin!. 
The Pointer -> Next is given Null making it the last node in the list. 


3.3.9 Reversing a One-way Linked List 

To reverse a linked list, we need to use three pointer variables. PO»t«- variaWe is 
used to store the address of current node, second ponder variable■ ^ 

address of next node and the third pointer variable will be used to store die address of 
next to next of current node. Here is the diagrammatical representation of reversing 

linked list. 




Reversing the linked list having only two nodes 
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Reversing the linked list with more th»n two nodes 


Algorithm: Reversing the one-way linked list. 

Step 1: If Begin = Null Then 

Print: “No node is present in the linked list” 

Exit 


[End If] 

Step 2: If Begin -> Next = Null Then //Linked list is having only one node 

Print: “Linked List is having only one node” 

Exit 
[End If] 

Step 3: If Begin -> Next # Null Then 

Set Pointerl = Begin 
Set Pointer 2 = Begins Next 

Set Pointer 3 = Pointer 2 -► Next 
[End If] 

sup 4: If Pointers = Null Then V Linked List is having only hvo nodes 

Set Pointerl - Next = Pointerl 
S& Pointerl -*■ Next = Null 
Set Begin = Pointerl 

Exit 


Step 5 
Step 6 
Step.7 
Step 8 


[End If] 

Set Pointerl -+ Next = Null 

Repeat Steps 7 to 10 while P„i nfer3 _ v 

S<*Polnter 2 N ext D Next * Nu ll 
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Linked List 

Step 9: Set Polnter2 = Pointers 

Step 10: Set Pointers = PotnterS -> Next 

[End Loop] 

Step 11: Set Pointer! Next = Polnterl 

Step 12: Set Pointers -> JVe*t = Pointer! 

Step 13: Set Begin - Pointers 
Step 14: Exit 

Explanation: 

In the first step list pointer variable Begin is checked, if it contains Null(means the 

linked list is empty) then an error message is displayed and control exit from the 

program. In step 2, next part of the first node is checked, if it contains Null then it means 
the linked list is having only one node so an error message is displayed and control exits 
from the program. In step 3, next part of the first node is checked, if it does not contain 
Null (means the linked list has more than one nodes) then three address variables, 
Polnterl, Pointer 2, and Pointers are initialized to the address of first, second and ' 
third nodes respectively. In step 4, Pointers which is pointing to the third node of the 
list is checked. If it contains Null, it means, list is having only two nodes. So, to reverse 
a two nodes list, first node is made as the second node and second node is made as the 
first node and then address of the second node is stored in the list pointer 

variable Begin. 

In step 6, a loop is executed within which step 7 is used to reverse the order of nodes in 
the list and steps 8 to step 10 are used to advance the Pointerl, Pointer! and 
Pointers respectively. The steps 11 and 12 are used to reverse the order of second last 
and last node. In step 13, the pointer variable Polnter3 which is currently having 
address of last node in it, is assigned to list variable Befltn. 


3.4 Circular Linked List 

A circular linked list is a list in which last node points back to the first node instead of 
coZS. pointer in the next part of the last nod. The circular Indeed Ust can 

be shown diagrammatically as: 



A Circular Linked List 
All the operations which can be performed on ordinary singular linked list can 
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it- Struct^ 

— ’th the fol^ wu# ®'— —' 

^oncrr^ 1 ** 1 . the ggje 0 f one-way singular linked [*,, 

'"Poking fbr *e «■*> °lf‘^tw. Mull address tat in ^ “fof** 

• Looking 1 ^ ^ node will con w ^ of address of the first node i 

iSedHst, the next part of the ^ ofthc circular linked list, we will conapj 
o ea ln Thus, for reaching again with address stored in Next part of e* 
2£~ '^ oCto be same, then we have reached a, a 

node. If both the addresses 

end of the circular ist ^ ^ c i rc ular linked list, it’s We 

• sritaf i-s ■* 1 *• - 

one-way singular linked list. 
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of circular linked list 

3.4.4 Appl‘ cat,onS 0 implementing a timesharing problem of i 

A circular linked list .^^vironment, the operating system must maintain«] 

operating system. lnat.mesh«ngen ^ ^ t0 use a slice of q 

of executing processes and tem wi H pick a process; let it use a so. 

time, one process at a time. TTae f g ^ next pr0C ess. For this application, the 

Sbfn?W~less there is absolutely no process requesting CPU time. 

3 5 Two-way Linked List (Doubly Linked List) 

In one-way singular linked list discussed in ^e«l" it '*] 

one direction i.e. from begmnmg to end But in certain PP I 

traverse die list in bo* accomplished £ith the help of 

two-way linked list. The two-way linked list is also J 1 p 1 

way linked list or doubly linked list, each node is divided into three parts Pre, in;o, 

Next. The structure of a node used in two-way linked list is as shown below. 

11 


pL 


Info 


Next 


Structure of a Node used in a Two-way Linked List 

• Pre part contains the address of preceding node 

• Info part contains the element 

• Next part contains the address of the next node 

Here, in the two-way linked list, two list pointer variables are used instead of one. These 
are Begin and End which contains the address of the first node and last node of the 
e ist respectively. Two-way linked list can be shown diagrammatically as: 

(Begta 


I 




10 


Null 

Info nU 


rr 




Null 



The Pre part of the fi A TW °" Way L,nked Llst 

faked P rT di u 8 "°de. tiillT? 61 list wil1 contain Null as th 
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Operations Performed on Two-Way Linked List 

The various operations that can be performed on two-way linked M are: 


Linked List 


Traversing 

• Searching 

• Insertion 

• Deletion 


These all operations are similar to the operations perfonned on one-way linked list with 
minor changes. Some of these operations are discussed in detail below: 


3.5.1 Traversing a Two-Way Linked List 

A two-way linked list can be traversed in both the directions i.e. in forward direction as 
well as in backward direction. 

If the two-way linked list is traversed in the forward direction, the pointer variable will be 
assigned with the address stored in the Begin pointer variable and move forward till we 
reach at node whose Next part contains Null i.e. we reach at the end of the list. 
Similarly, while traversing the list in the backward direction, the pointer variable will be 
assigned with the address stored in the End pointer variable and move backward till we 
reach at node whose Pre part contains Null i.e. we reach at the begining of the list. The 
variable Pointer keeps track of the address of the current node. 



Two-way Linked list for backward/forward Traversal 

Algorithm: Traverses a two-way linked list starting from the end of the list to the 
beginning. 

Step 1: If End = Null Then 

Print: “Linked List is empty” 

Exit 
[End If] 

Step 2: Set Pointer = End 
Step 3: Repeat while Pointer ^ Null 
Process Pointer -»Info 
Set Pointer * Pointer-> Pre 
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[End Loop] 

Step 4: Exit 

Explanation: list j s empty or not. If the 

In this algorithm, step 1 is used to check whi ^ ^ from the program . in step 2, 

given linked list is empty then a messa 8 el * p f th last no de (as the traversal is 

the variable Pointer is initialized wtth the at the beginning of the 

done from last node). Step 3 is used to executethe top tore 
linked list starting from last node and within die loop, the injo p 
processed and Pointer is set to its previous node. _ . 

Reader can traverse the two-way list in the forward direction which is similar to the 
backward traversal. 

3.5.2 Searching in a Two-Way Linked List 

In a two-way linked list, to find the location of a given item, we can traverse the list 
starting either from the end or from the beginning of the linked list. While traversing, we 
compare the element stored in each node with the desired item. If desired item is found 
then further traversing is stopped and the address of the node containing desired element 
is returned. Here, we will search the item by starting the search from the end of the list 
until the desired item is found or we reach the beginning of the list. 

Algorithm: To find the position of a given element 'Data' in a two-way linked list by 
traversing it from the end to beginning. 


Step 1: 

If End = Null Then 


Print: “Linked List is 


Exit 


[End If] 

Step 2: 

Set Pointer = End 

Step 3: 

Repeat While Pointer * 


If Pointer -> info 


Null 


Print: “Element Data is found a t 
Exit 


address "Pointer 


Else 


Pre 


Step 4: 


Set Pointer = 

[End If] Pointer 

[End Loop] 

Print: “Element Data is not f 

found in the linlc ed Us .” 
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Step 5: Exit 


Explanation: 

In this algorithm, the 1* step is used to check whether the given linked list is empty or 
not. If die given linked list is empty then a message is printed and exit from the program. 
Step 2 is executed if the linked list is not empty and the variable Pointer is assigned the 
address of last node of the list. In step 3, a loop is executed and within the loop, if the 
Info part of the node Pointer is equal to desired element Data then a message is 
printed and exit from the program. Otherwise, the address of previous node is given to 
the Pointer variable. These steps will be repeated until the variable Pointer reaches at 
the Pre part of the 1 node (i.e. Null). If the variable Pointer becomes Null then we 
come out of the loop and it is evident that the desired element Data is not present in the 
linked list. 


3.5.3 Insertion of an Element in a Two-Way Linked List 

Insertion can take place at various positions into the two-way linked list. It may be 
desired to insert a new node at the beginning of the linked list, at the end of the linked list 
or after a particular node in the linked list. Insertion at the beginning or at the end of the 
linked list is a very simple operation as it can be accomplished after changing a few 
pointers. But insertion after a particular node in the linked list requires finding the 
location of the node after which new node is to be inserted. 

3.5.3.1 Inserting a New node at the Beginning of Two-Way Linked List 

Below is the algorithm to insert an element Data at the beginning of the doubly linked 
list. The following diagram illustrates the insertion operation at the beginning of the 
linked list. 



New 

Insertion of a node in doubly linked list 
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. H. . U |„ mi.. 

^^ 0 ^»" ewn#dea ' 

, lfFree = Null Then 

S ' epl; Print: “Free space no. available” 

Exit 


Step 2: 

Step 3: 
Step 4: 


Next ) 


[End If] 

Allocate memory to node New 

(Set New = Free And Free - r£?£? _ p flffl 

Set New -> Pre = Null And flew->/n/o 

HBealn = iVu/f Then 

Set New ^ Next = Null Ani End = Alow 


Step 5: 
Step 6: 


Else 

Set Wew -» = 

[End If] 

Set Begin = New 
Exit 


Begin And Begin-> Pre - New 


Explanation: 

Step 1 is used to check for the free space in free storage list If space is not available then 
an error message is displayed and exited front the program. If free space is avai lable teen 
in the step 2, a node is allocated to the linked list for insertion. Step 3 is used to prep 
the allocated node by putting the element Data in the Info part and Null in the Pre 
part of (because the node is to be inserted as the 1 st node) the allocated node. 

In step 4, the new node is inserted as the 1 st node in the linked list. If the list is already 
empty, then the new node will be the 1 st as well as the last node. So, we put Null in the 
Next part of the node and End is assigned the address of New node. If linked list is not 
empty then New node is inserted as the 1 st node by putting the address of 1 st node in the 
^[^^P^rtofA^evvjiodeand^address^of New node in the Begin variable. 


Insertion at the end of the list can be accomplished in the similar manner and is left for 
the readers as an exercise. 

3 5-3,2 LinkedList NeW N ° de af ‘ er 3 Particular Node in Two-Way 

the nod^after which'insertbn wm tekTV' 813 3 particular node - Sod the position of 

node, tee uew node can be ta se n d^.S f 6 ' k After findi "S ‘he position of the desired 
figure: ,nserted oostly by changing few pointers as shown heloW i» 
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Insertion of a node 'New' in the linked list after a particular element 'Data' 

Algorithm: Insert a new element 'Item' after a given element 'Data' in the two-way 
linked list 

Stepl: If Free = Null Then 

Print: “No free space available” 

Exit 
[End If] 

Step 2: If Begin = Null Then 

Print: “List is Empty, No insertion will take place” 

Exit 
[End If] 

Step 3: Set Pointer = Begin 

Step 4: Repeat While Pointer -> Next * Null AND Pointer -> Info * Data 
Pointer = Pointer -> Next 
[End Loop] 

Step 5: If Pointer -> Next = Null AND Pointer -> Info * Data 

Print: “Item cannot be inserted as element Data is not present 

Exit 
[End If] 

Step 6: Allocate memory to node New 

(Set New = Free And Free = Free -> Next) 

Set New -* Info = Item 
Step 7: If Pointer -> Next =£ Null Then 

Successor = Pointer -* AfcAtf 
Atew -► Ate*t = Successor 
Pointer -> = Atew 

Afcw Pre = Pointer 
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||ir ., . rr oadr t " nataStrUCt<lgS ..Hj 

Successor -*Pre = New 
N ew-> Next = Null 

New-*? re ~ Pointer t 

Pointer -> Next = New 
End = IVevv 
[End If] 

Step 8: Exit ______ 

Explanation: ^ w chec k for the free space in free storage U«d 

In the above algorithm, the 1 P meccaue is displayed and exited from thd 

If free space is not available to i an err | ^ ^ ^ checked If , J 

Sp* tJ aTes'LS displayed and exited from the program because node «o J 
S afer a particular node containing element Data.s not present as the hstu 
empty. Step 3 1 step 4 are used to reach at the portion where new node «Mo be 
inserted after finding the particular node containing element Data. If we reach at the last 
node as in step 5 (i.e. Pointer -* Next = Null ) and the Info part of this node is not 
equal to required element Data then it means that the new node cannot be inserted as 
desired element Data is not present after which new node is to be inserted. So, we exit 
from the program. If we come out of loop before reaching at the last node ( Pointer -» 
Next * Null ) then it means we have found the node containing the element Data. So, 
we insert the new node after this node changing some pointers in step 7. If we come out 
of the loop reaching at the last node (i.e. Pointer -* Next = Null and Pointer 
Info = Data ) then we insert the new node as the last node of the linked list changing 
some pointers in the else part of step 7. A 


3.5.4 Deleting a Node with given Item from 2-Way Linked 

For deleting a particular node, we will traverse the list in either forward or back 
direction to locate the node containing the element to be deleted. While traversing the 
if the node containing the item to be deleted is found then it can be removed from 
linked list by changing a few pointers. On the other hand, if the desired node is not fo 
and we reach at the end of the list then an appropriate message is displayed. 


f 


I 


Nulll 5 


A Two-way Linked List with 5 Node. 


9 Null 
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_ i. Sunpose, we want to delete an element 5 whtou 
jj^ st *Deletion will be performed as shown in figure below?^ 11 ^ m th ® first node of 

& 


Begin ■ Begin—►Next 
Begin—►Fre ■ 

Deleting the 1 st Node of a Two-way Linked List 


Case 2: Suppose, we want to delete an element 7 which is contained in a node that lies 
between first and last node of the list then it will be performed as shown in the figure 

below: 







Previous 


Pointer Successor 


Previous—►Next» Successor 

Successor—Wre = Previous 


Deleting a Node present between 


first and last node of a Two-way Linked List 
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//First Node to be deleted 


Step 2: 


ASi 

Alflorfthm: Delete 

Stepl: ’ f Be ?nnt: “Unkll List is already empty" 

Exit 

Pos - Begin 
Begin = Begin - Next 

Begin -* Pre = Null 
//Deallocate memory held by Pos 

POS -* Next = Free, Free = Pos 

Exit 
[End If] 

Set Pointer = Begin-* Next 

Repeat While Pointer -* Next * Null AND Pointer -* Info * 
Set Pointer = Pointer -* Next 
[End Loop] 

If Pointer -* Next = Null AND Pointer -* Inf o & Item 

Print: “Item to be deleted not found” 

Exit 
[End If] 

If Pointer -* Next = Null Then 

Set Previous = Pointer -* Pre 
Set Previous -» Next = Null 
Set End = Previous 

Else 

Set Previous - Pointer-> Pre 
Set Successor = Pointer -► Next 
Set Previous Next = Successor 
Set Successor -* Pre — 

[End If] 


Step 3: 
Step 4: 


Step 5: 


/tern 


Step 6: 


//Last node to be deleted 


Previous 


Step 7: Deallocate 


Step 8: Exit 


memory held by Pointer 

Pointer -> Next = Free, Free = 


Pointer 
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Exptantttonj — Linked 

the 1* step, the linked list is checked. If linked r ,. 

,nd exit from the loop. In step 2, the element ftJi • ‘ S <hen a mes . a „ • 

node is the node to be deleted then the Begl^ll t*** 1 in ^ I'nol ifT^ 
vMBegln = Begin - Next) and thedefi S '? Set to *• S on- 
deleted is not 1 node then we come to 3 rd step inwhichl‘ S ^ located - If the node It 
address of 2" node. In step 4, a loop is executed intfathp P ? <ntervariable » tl ta the 
I node based upon the conditions. We reach at step 5 if th/p^ Variable is set to next 
at the last node and the Info part of this last node is not Variable has rea <*ed 

the node to be deleted does not exist. So, a message is printed^ /tem . then means 
The step 6 is executed if the element Item is present inth* i .! ^ CXIt from ** Ioo P- 
and last node. The If condition of 6 th step check fo r he l “ " r 7 bctWKn * >“ 

-*•-«*«» «-*» f «•«. 

any node between the 1 and last node.In step 7, the deleted node Polnte? " 
deallocated. IS 


3.6 Header Linked List 

A header linked list is a special kind of linked list which contains a special node at the 
beginning of the list. This special node is known as head node. This head node contains 
important information regarding the linked list. This information may be total number of 
nodes in the linked list, some description for the user like creation date, modification 
date or information about, whether the data in the list is sorted or unsorted. The header 
linked list is shown below: 


Jegin 


40 Null 


Header Node 


A Header Linked List 

Depending upon the application, there are some categories of header li 

• Grounded Header Linked List 

• Circular Header Linked List 

• Two-way Header Linked List 

• Circular Two-way Header Linked List contains the Sul 

7 grounded header linked list is a list, in Which last bo ^ ^ * grounded M* 

J* Hext pointer field. The header linked h* * own 
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figure below: 


Null value will be stored in the ]y e 





Null 


Header Node 

An Empty Grounded Header Linked List 

A circular header linked list is a list in which last node of the list points back to the 
header node i.e. Next pointer field of the last node contains the address of the header 
node. Circular header linked list can be shown diagrammatically as: 



A Circular Header Linked List 

If the circular header linked list is empty then this situation is handled by storing the 
address of the head node in the Next pointer field of head node itself. The case of empty 
circular header linked list can be shown diagrammatically as: 

JJegin 



An Empty Circular Header Linked List 

In general, a header node can be incpt-tod • 

way lin ked list . A two-way header linked Hstcan^s^ lmked list either one-way or two- 



way Header Linked List 
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A two-way circular Header linked Ust can be shown 

■M 


Linked List 



Circular Two-way Header Linked List 

Operations Performed on Header Linked List 


All the operations which can be performed on the one-way linked list or two-way linked 
list can also be performed on header linked list with a few changes. For example, while 
traversing a header linked list, we will start traversing from the node which is next to the 
header node (i.e. 2 nd node) by storing the Next of Begin into the variable Pointer. If 
our header list is circular then the end of the list is checked by comparing the address 
stored in the currently scanned node with the address of the header node as in a circular 
header linked list, end of the list is marked by storing the address of the header node in 
the Next field of last node. 


Algorithm: Traverses a circular header linked list 
Step 1: If Begin -> Next = Begin Then 

Print: “Circular Header Linked List is empty” 
Exit 


[End If] 

Step 2: Set Pointer = Begin -> Next 

Step 3: Repeat Step 4 and 5 While Pointer * Begin 

Step 4: Process Pointer -* Info 

Step 5: Set Pointer = Pointer -> Next 

[End Loop] 

Step 6: Exit 

All the other operations can be performed in the similar manner 
exercise for the readers. 


which is left as 40 
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structure of the node will be 


Linked List 


“shown in , he f lgurebelow; 



Co-efficient 

of the term Power of th P » V - - to the 

Structure of . Node used iu a Linked List „ £££ 

The hnKed .is, representat.cn of the p olynomials „ and ,, J^****— 

c Wl11 be as shown in figure 


% 



-8 3 


6 1 


9 0 


“L 


Linked List Representation of the Polynomial 'PI' 


Null 


-4 


-2 


Null 


Linked List Representation of the Polynomial 'P2' 

After subtracting the polynomial P2 from PI, the linked list representation of the 
resultant polynomial will be as shown in figure below: 



Linked List Representation of the Resultant Polynomial 'P' 
Algorithm: Subtract a given polynomial 'P2' from another polynomial PI. 

Step 1: If PI = Null OR P2 = Mi Then 

Print: “One or both the polynomials are Null ” 


Exit 
[End If] 

Step 2: If Free = Null Then 

Print: “No free space available” 

Exit 
[End If] 

Step 3: Set P = Null 

Step 4: Allocate memory to node New 
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-—- U Free And Free = Free -* M?**) 

(Set New = Free Ana nc 

pi And Pointer2 — P 2 
p ow = pointer2 -> Pow Then 


Step 5: 
Step 6: 


Coi 


Step 7: 


Step 8: 


Step 9: 
Step 10: 


Step 11: 
Step 12: 


(Set New 
Set Polnterl 

lirolnterl - Po* = PO«n«r* - . -■ --- 

Set New -* Coe// = Potnterl -* Coeff - Polnter2 

Set New -* Pow = Polnterl -> Pow 

Set Polnterl = Polnterl -> Next 

Set Pointer2 = Pointer2 -> Next 

[End If] 

If Polnterl -»Pow > Pointer 2 -* Pow Then 
Set New -> Coeff = Polnterl -* Coeff 
Set New -» Pow = Polnterl -* Pow 
Set Polnterl = Polnterl ->Ne*t 

Else 

Set New-* Coeff = -( Pointer2 -> Coeff) 

Set New -> Pow = Pointer 2 -> Pow 
Set Pointer 2 = Pointer 2 -> Ne*t 
[End If] 

Set New -> Ne*t = Null 
Set Pointer = New 
Set P = New 

Repeat Steps 10 to 13 While Polnterl * Null AND Pointer! * Null 
If Free = Null Then 

Print: “No available space” 

Exit 
[End If] 

Allocate memory to node New 

toNe w / c Z^:T 2 " P0WThm 

Set New -» p 0lv - ° nterl “* Coe // - Pointer 2 -> Coe// 

Set Polnterl'- » ^°* nterl "* Potv 

S«Polnter 2 = , *** 

Pointer! -* (Vert 
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Step 13: 


Else If Pointerl p 0 w > p„ 

Set New -* r„.« - Pow Then 

Set New -* Coe// = P otnterl 

Set New -> Pow = Potnterl PoM , 

Set Pointerl = Pointerl * Next 

Else 

Set New - Coe// = -(P 0 |„ ter2 _ Coe//) 

Set Afew -► Pow = Potnter2 -> Pow 
Set Pointerl = Pointerl -* Next 
[End If] 

Set JVew -> Next = Null 
Set Pointer -» Next = New And Pointer = New 
[End Loop] 

Step 14: If Pointer 1 = Null Then 

Repeat Step a to g While Pointerl * Null 
a If Free = Null Then 

Print: “Not enough space” 

Exit 
[End If] 

b Allocate memory to node New 

(Set New = Free And Free = Free-* Next) 
New -> Coeff = -(Pointerl -> Coe//) 

New -> Pow = Pointerl -> Pow 
Pointerl = Pointerl -> Next 
Set New -* Next = Null 

Next = New A” 11 Pointe " N 


c 

d 

e 

f 

g 


Set Pointer 


Else 


[End Loop] 

a If Free = Null Then 

Print: “Not enough space 

Exit 
[End If] 


— 
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c . . nl -u^n a ta structure.----- 

to node *e* § 

b Z^-^e^ree-Fr ee-.Se* 1 

. New -* Coeff = Polnterl ^ Coeff 9 

d . New - l-ovf = Pointer! - Potv 1 

e . Pointer! = Pointer! -> Next 1 

f. Set New-* Next = Null I 

g . set Pointer-> Next = New And Pointer - New 

■ 

[End Loop] 

[End If] 

Step 15: Exit 

3.7.2 Storage of Sparse Array j 

Sparse array and its array representation have already been explained in chapter of array 
The main problem in the array representation of sparse array is that, it requ I 

data movement while insertion and deletion of elements. This data movemen a 

avoided if the linked representation is used to store the sparse array. Many ways ^ 
representing the sparse array using linked lists have been proposed, each with its own 
advantages and disadvantages. Here, we are discussing linked representation of sparse 
array which is very simple to understand and easy to implement. Consider a two - 
dimensional array A of order 5 X 5 as shown below: 

[4 0 0 2 01 

0 0 9 0 0 

A=0 0 0 0 0 

0 5 0 0 6 

L 7 3 0 0 12- 

A Sparse Matrix A of order 5x5 

number. As discus^ed^earlier ^ ** necessar y to specify its row and column 

store the non-zero w^w i^tlw^^ay 0 While 16 ^ We « al ^ S "ed tO 

structure of the nodes in the linked J'will be « ”be!ow‘ W ° dimensi ° na ' 


Row 

Number 


Pointer to ^ Pointer to Column 
Next Row ™ T** non-zero Number 

element of 
the Row 



Element 


the Row 
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Linked List Representation of Sparse Matrix 'A' 

1 a amv i« presented using the linked list, various operations like 

When the sparse array ^ de | etion of elements and modification of elements 

insertions of new non z operating on the linked representation of 

blVameTfin case of ordinary linked lists discussed in the preceding 

sections. 

3 7 3 Implementing Other Data Structures 

Linked lists are frequently used to f^ruroffinker^ mTmp.rent toTt*. 
like stack, queue, tree, and graph. Thet use of 1m 
structure will be discussed in the subsequent chapters. 
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Chapter 4: Stack 


4.1 Introduction 


Stack is one of the most commonly used linear data structures of variable size. In the 
linear data structure discussed so far i.e. array, the insertion and deletion of an element 
can take place at any position of the array but in the case of stack, the insertion and 
deletion of an element can occur at only one end known as Top. In stack, insertion 
operation is known as push and deletion operation is known as pop. Stack is also 
called Last In First Out (LIFO) list. It means that the last item added to the stack will 
be the first item to be removed from the stack. Consider an example of stack of dish 
plates in which clean plates are added to the top of the stack. Also, plates are removed 
from the top of the stack. The first plate put on the stack is the last plate to be removed 
from the stack, as shown in the figure below: 



Stack Showing Push and Pop Operation from the Top Position 

Although, stack is a restricted kind of data structure but it has many applications in 
programming. 

In this chapter, first of all, we will discuss about the operations associated with the stack. 
Then, we will discuss the various applications of the stack. 


4.2 Operations on the Stack 


Two basic operations performed on the stack are: 

• Push 

• Pop 
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Jim I , . Ztin. nf a new element into the stack. Obviously* 

Push opetahon tefera *° ® “j 8 ^ of ^ sta ck. We can perform the push open* 
new element will b ® mse J^k sufficient space to accommodate thejS 

etrC Sn an aUempt is made to insert a new element J 

the stack then this condition is known as stack overflow. 1 

Pop operation refers to the removal of an element from the top of the stack. We «| 
perform the pop operation only when the stack is not empty. Therefore, we must ensni 
that stack is not empty before applying the pop operation. When stack is empty and wd 
are attempting to remove an element from the stack tuen this condition is known as stack j 

underflow. 

Consider the list of 5 elements which are to be pushed in the given order into an empty] 
stack. The list is 50,60,70,80, and 90. The push operation is shown in figure below: 


To P-H 50 


T°I>-W70 


Top-H 60 


- ^ □ 1501 

As discussed earlier ZT" ^ °“ * ** 

Here ^"- in reveree ° rder ° f ^ ** wa * 

and hence can bZ 9 °' Then - to top "le ent 40 be ren «>ved first is the one St 
nee can be removed i.e. element 80. ^ WiU bec °me the topmost element 

i A . ^ 


- vicment soo me topmost eiemw 

^ e :? R ~««n„ f s,„ k 

jj 

«>* , s,i*tZl S K repre8ent n«oZf 1 ? Um Si2e °an bl Z° f Stack is accept* i(0 

11811 accurate estimate o 
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4J.1 Array Representation of Stack 

Representation of stack using an arrav « «, . 

puts certain restrictions while ‘ me slm Plest form nfr* n ~ 

wnne representing the stack: presentation. But an array 

• The stack must contain hnm„„ 

* O’ 1 ' must s P«Ify the upper bound 1 * fT el ' men,s 

must be defined before implementing it GeSt'T™" ^ ° fth ' •** 
time but it is confined to the space ll„ , T S™** 21,(1 over 

stack. SpaCe allccated to the array imp i ementing J 


stack. 

stack’s topmost elementTnitidly 8 “efck fs emptl'ro^hl T*\ ‘° h ° ld “* index of 
when first element is inserted into the stack, the vXf of ^ 10 “ d 

so on. Each time a new element is inserted intn th u * S mcremented by one and 

srt srf3“p-vstats 


Following algorithms explain the push and pop operation on the stack when it is 
represented using an array: 

Algorithm: Push Operation - Insert a new element 'Data' at the top of the stack 
represented by an array 'S' of size 'Max' with a stack index variable 'Top' pointing 
to the topmost element of the stack. 

Step 1: If Top = Max Then 

Print: “Stack is already full, Overflow Condition” 

Exit 

[End If] 
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^oli§i0%~- -- “ from th* »t*«k repretenud 

Operation - D«*ete » ^ at the top of the stack, 

returns the element Data won 

% Ifrop = NULL Then nfv Underfl ow Condition” 

Print: “Stack is already empty, Undemow 


[End If] & 

Step 2: Set Data = S[Top] ■ 

Step 3: Set Top = Top - 1 ■ 

Step 4: Exit m M 

I to dTfet step of this algorithm, the underflow condition is checked. If the stack ill 
rireadv empty and we are trying to perform the pop operation then a message will be I 
displayed before quitting the program, to the instep, the top most element of the stack i, 1 
stored in a variable Data for its use in future and index To p is decremented.-_J| 

As discussed earlier, when stack is implemented using an array, there is a need to allocate 9 
sufficient fixed space for the stack. If, initially we reserve large amount of space for the ■; 
stack, then it will decrease the number of overflows but there will be wastage of memory f 
as memory remains unutilized most of the times. 

On the other hand, if we allocate small amount of memory space for the stack then it can 
increase the number of overflows. For resolving such overflows, more memory space can 
be added to the stack as and when required. But, this addition of memory will require the 
time which may be more expensive than the space saved. 

This time space trade-off (while implementing the stack using an array) can be resolved 
using various techniques, one of which is described below: 

Generally, algorithms require more than one stack. It may be the situation that, one stack 
encounters overflow condition while other stack is far from being full In such a case, 
instead of imposing limit of maximum size on each stack, we can allocate a common pool 

" hlch . c “ ' be t us ? d by aU the stacks - Conner an algorithm which require* 
Stacks SI and S2 which can exist together in the same array as shown in figure 

*^one 8 Swr to 3rtoit. the ^ StaCk WU1 ^t while » 


Bottoml Topi 

Stack 'SI' 


:k 'SI* To P 2 Bottom2 

cu „ Stack 'S2' 

Storage of Two Stack, .„to , single Array 
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In this s r ,i.wm ^possible for one stack to consume more than half the space 
allocated to bo* 1 ’*<*.'««*»* will occur only when the total size of two 

stacks excee s _J\. r - e ° ^e stacks at a particular time. This approach 

J^fTfoe two stacks. W,th ° Ut - total «"* <* *“• 

4,3.2 Linked List Representation of Stack 

Stack can also be implemented using the linked list. By implementing the stack using the 
linked list, we can eliminate the drawbacks which come across while implementing the 
stack using an array. That is, while implementing the stack using the linked list, there is 
no need to know in advance about the maximum size of the stack. Linked list 
representation of the stack allows it to grow without any prior fixed limit. 


50 Null 


already been discussed in the chapter on hnked .s . ^ ^ t#p #f the stacU 

Algorithm: Push Operation - Ins * rt a *',“ter variable Top’ pointing <» the 
represented by the linked list with a stack pom 

topmost node of the stack. 


Step 1: 


Step 2: 

Step 3: 
Step 4: 
Step 5: 


If Free - Null Then Overflow Condition” 

Print: “Free space not available, Overtiow 

Exit 

t End If l . New from free memory pool. 

Allocate memory to a node N ~ ^ Next 

Set New = Free And Free ^ Next = Top 

Set New-* Info = Data Mi New 

Set Top * New 
Exit 
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Illustration of Push Operation Performed on Stack 


Explanation: — 

In the 1 st step of the algorithm, the availability of free space is checked. If free space is 
not available in free storage list, an error message is displayed and exit from the program ' 

In 2 step, a node is taken from the free memory pool and assigned to a pointer variable I 

4 ' h „ ste P>. the node New is prepared by assigning its Info and Next part sod 
inserted at t he 1 position of the linked list as shown in figure above. | 

Unked^UsTand returnsThell < , Ien,en ‘ from the stack represented by th. 

nnKed list and returns the element Data which is at the top of the stack. 

Step 1: If Top = Null Then 

Print: “Stack is Empty, Underflow Condition” I 

[End If] 

zt :— 
s,ep4: ^::tr- n rnr es,ora8e,ist I 

Steps: Exit ~ “ And Free = Temp 


Ste P 5: Exit 


Temp | 


50 | Null I 


Illustration of Pop Operation Perfor 


med on a Stack 
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Explanation. 

In the l*‘step of the algorithm, the stack is checked whether it i,, o 

(Top * Null), then an error message is printed and exit from the^r^m'“ 6mpty 

In the 2 nd step, the Info part of topmost node of the stack i» • 

D ata for future use and its address is stored into a pointer variable . variabIe 

m free storage list in step 4. _ v r vanable Tem P which is sent 

Although stacks can be implemented using linked list by pushing or nomine , 
a, the beginning of the Unked list but the most of the common fpplicaE‘ “,ftS 
have space consent. Thus, an array implementation of the stack is natural andeflS 
one. In most of the operating systems, allocation and deallocation of the memorv is 
relatively an expensive operation and this is the penalty being paid for getting the 
flexibility while implementing the stack with the help of linked list. 


4 A Applications of Stack 

As mentioned earlier, the stack is used in wide variety of applications. These are 
extensively used in system programming (compilers and operating systems) and 
application programming. In this section we will discuss a few applications of the stack. 


4.4.1 Evaluation of Arithmetic Expression 


An important application of stack is the compilation of arithmetic expressions in the 
programming languages. The compiler must be able to translate the expression which is 
written in the usual notation known as infix notation to a form which is known as 
reverse polish notation. Compilers accomplish this task of notation conversion i.e. infix 
to postfix with the help of stack. 

Before discussing this application of stack, let us first discuss about the various notations 
that are used for expressing arithmetic expression as follows: 


4.4,1.1 Infix Notation 

The most common notation that is used while expressing arithmetic expression is infix 
notation. In this notation, operator is placed between its °P®^ an •• eneonleto 
multiply m and n we write mxn.lt is the notation that is use y notation the 

solve any mathematical/arithmetic expressions. But, while so vi g ^ afl4 , rtJ , lorivltv ’ for 


any mmiMTOBi/aiiu™™ ^ associativ ity. 

main consideration is the precedence of the operato 

example, consider an expression, 


e = <? x r + 

In this 
is added 
operator 


expression, following the precedence rules, q and r ^ ™ Jj, e -(-(addition) 

ed That is, x(mult, pi,cation) operator has precedence over td 
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Wiito fl0tat * on » we ^ ave t0 distinguish between (q x r) + s and q x (j* ^ 
using either operator precedence rule or by applying some parenthesis. Such t 
sapressions cannot be solved accurately if we do not follow the rules of oj 
precedence and their associativity. m 

The main problem with this notation is that the order of operator and operands in 
expression does not uniquely decide the order in which operations are to be carried 


b 



Priority 

Operator 

Associativity 

1 st 

Brackets 

Inner to Out and Left to Right 

2 nd 

Exponent A 

Left to Right 

mm 

* / 

Left to Right 


4 + - Left to Right 

5 th = Right to Left 

Table showing the precedence and associativity of the various operators 
Consider an expression, 

e = 4 - 2 A 4 + 8 x 3 +18/3 + 6 

A havmg hlghest P rei =edence over the other operators, will be solved first 

e = 4— 16 + 8x3+ 18/ 3+6 

same lev^of precedence! "" ^ Perf0m,ed from left ** because both are M 

e = 4 I 16 + 24+18/3 + 6 

same level of precedence S W ' U ^ perfonned from left to right because both are havi 

« = -12 + 24 + 6 + 6 

e = 12 + 6 + 6 

e = 18 + 6 

***'— Of expression Jj 

to the infix notatio^tlTe b!ac X keltal 6 h ~ 36)/6+ < 3 X «) + 7 

^vtogtgh'eX S ei n f WTitten inside toeTackete * e operatorpreceded 

itoest level of precedence. bra ° kets Wl11 be evaluated fat as brack* 
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e = 5 x 3 +-g-+ 30 + 7 

x and / operations are performed from left to right, 

e = ^5 + 4 + 30 + 7 
+ and - operations are performed from left to right. 

e = 56 


4.4.1.2 Prefix Notation 

This notation is also popular with the name polish notation which is named after r»li.h 
mathematician Jan Lukasiewicz. In 1920’s, this polish nathemaSTde^oS a 
system in which mathematical expression can be specified without parenthesis by placing 
the operator before or after its operands. In prefix notation, operator is placed before its 
operands. For example, to multiply m and n we write Xmn. Other arithmetic 
impressions like addition, subtraction, division, and exponential will be performed as 

_ _ oa / m tl A tVI tl rncnnMnmltr 


expressions-- , - 

+ mn, -mn, /mn, A m n respectively 


The main characteristic of this notation is that the order in which the operations are to be 
carried out is completely determined by the position of operators and operands in the 
expression. While solving the arithmetic expression which is written in prefix/polish 
notation, there is no need to take care of any precedence rule and there is no need to put 
the parenthesis in the expression. 


Below are some examples of the expressions which are written in infix notation (M and 
are to be converted into polish notation (/ pre )- In order to transate an ani e c 

expression from infix to polish notation, we will do it step by^step the 

brackets) to indicate the partial conversion. This means p 
square brackets will be treated as a single operand. 


Example 1: 


Iin = (« - *>)/ c 
= [- a b]/ c 


Ipre=/- abC 


Example 2: 

i in = (* - y) x ((* + 

= [-xy] X ([+2V]//) 
= [- x y] x [/ + z v /] 

I pre = X -xy / + zvf 
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/,„ = ((a + 6) / d A (( c -/)+*)) 


= ([+afc]/d A ([-e/] + fl)) 
= ([ + ab]/d A [+ - efg ]) 

= [ + ab]/[ A d + -efg] 


Ipre — / 4" db 


d + -efg 


Example4: l ln = (x • y) + (z + ((a + b - c) * d)) - i * (//*) 

= (x * y) + (z + (([ + a 6] - c) » d)) - i « (/ / *) 

= (x * y) + (z + ([- + a b c] * d)) - i * (J / k) 

= (x * y) + (z + [* - + ab c d]) - i * (j / k) 

= [* xy] + (z + [* - + abed]) - i * (j /k) 

= [* xy] + [+z * - + abed] - i * (j / k) 

= [* xy] + [+ z * - + a b c d] - i * [/ j k] 

= [* xy] + [+ z * - + abed] - [* i/jk] 

= [+ * xy + z * - + a b c d] - [* i / j k] 

= -+ *xy + z*- + abcd*i/jk 


*pre 


4.4.1.3 Postfix Notation 

The postfix notation is also known as reverse nniich m * ** T 

is placed after its oneranHc a *+u polish notation. In this notation, of- 

f aiier ns operands. Arithmetic operations like + v / j a •„ 
with its operands mand n as ™ ^ 10ns +, X, / and A will be she 

respectively. The fundamental characterise/ 1 n ~\ mnx < mn/and f»l 
parenthesis to designate the hierarchy of oner °* notation is that there is no need* 
completely determined by the order of opemnds^nH^ thlS notation> order of °P eratioD 

Below are some examples of the exoL • ° Pera, ° rS ' 

infix ln *° reverse Polish notation In order , Wr ' tten in ' n i> x notation and are 
o 6 P0lish notation . we will do fl °u COnVert an ari *te>«tic expression 

* e partial conversion Thk m '‘f.? by ste P b V “ing [) brae 
be trea,ed * a single operand ““““ 0,6 ex P^sion within the square brt 
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• - *)/« 
• •**«/ 


• t» - jr> . (t» • *>//“, 

• t»»-i • (u»»i/n 


► f„ * 


• •»/# vf# - r • # 

tl»fr*|/4"rw-f * # t 
<M * ♦ f - « 

< i» * * ' # • f “ # * 

0 h * 4 • f § * 


♦ I- * 


«.., • .*<•*» •' •* - • • J •’ 

». <o*»*s * '* • * ' ‘ * u ' *’ 

. » . u > « - • * *0 * * ’ WM> 

* » « * * t # 

, . 4 . «» • >• * 'V - 1 ’ 

• * *• * * * * 

j , « - k • j <f 

i,« -i • i**> * '■ * 

L« t • • ,i * 1 . 

|n * * |4> . . , 

* * *■ 


• f i i 




• * * lf» * ~ 
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M jn computer, an arithmetic expression which is written in infix n 
Sated in two steps. In the first step, the expression is converted in the reverb 
.notation and in the second step, the converted expression is evaluated. The reason L 
^this notation conversion is that postfix notation is very efficient for the point of vf 
evaluation done by computers. As postfix expression is scanned from left to 
operands are simply placed into a stack (last in first out) and operators 
immediately applied to operands which are at the top of the stack. By contrast, exj 
with parenthesis and precedence (infix notation) require the operators to be delay* 
some later point. Thus, compilers in all modem computers convert the ari 
expressions to reverse polish notation for evaluation. 


* 


Algorithm: Convert an arithmetic expression 7' written in infix notation into 
equivalent postfix expression 'P'. 

Step 1: Push a left parenthesis (onto the stack. j 

Step 2: Append a right parenthesis ) at the end of the given expression /. 

Step 3: Repeat Steps from 4 to 8 by scanning / character by character from left to tight 

until the stack is empty. 

Step 4: If the current character in / is a white space, simply ignore it. 

Sep 5: If the current character in I is an operand, write it as the next element of the 

postfix expression P 

Step 6: If the current character in / is a left parenthesis (, push it onto the stack. 

Step 7: If the current character in / is an operator Then 

a. Pop operators (if there is any) at the top of stack while they have equal I 
or higher precedence than the current operator and put the popp#f|| 
operators in the postfix expression P 

b. Push the currently scanned operator on the stack. 

Step 8: If the current character in / is a right parenthesis Then 

a. Pop operators from the top of the stack and insert them in the post®’ 
expression P until a left parenthesis is encountered at the top of the stack* ^ 

b. Pop and discard left parenthesis ( from the stack. 

[End Loop] 


Step 8: 


Step 9: Exit 


Explanation: l —“ . 

value In the stack^hfiS^”^ 1 *** ° f the expression whic b is indicated by M 


V; 


wm” 
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White space present m the expression n jg_ t "*~ 

Operand encountered is written in the postfix expression. 

Left brace encountered is pushed into the stack. 

If operator is encountered in the infix expression / then th<» a 

the stack are removed and appended in postfix exnressi™the top of 

popped operators is equal to or more than the currently sc^n^u * ** preced ®<* of 

scanned operator is pushed into the stack either the operatore l n^'J 1 " ?" ntly 
or not. ^ are popped from the stack 

If right brace is encountered then all the operators from th, „,.„t, 

appended onto the postfix expression P until the left brace is encounte 

This left brace is also popped from stack and discarded. Continuing the abo™£t 

will reach at the end of the expression (indicated by Null present in the stack) and 

expression P will be the resulting postfix expression. ; 

Consider an expression, / = (6 + 2) x 5 - 8/4 

Let us transform this infix expression / into its equivalent postfix expression P using the 
algorithm. 


/ = (6 + 2) x 5-8/4) 
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Approach to Data Structures 

4 4 . 1.4 Evaluation of Postfix Notation 

Algorithm: Evaluate an arithmetic expression 'P' written in postfix notation 
calculates the result of the expression in variable 'Value . 

Step 1: Scan P from left to right and Repeat Steps 2 and 3 for each scanned characte 
until end of the expression. 

Step 2: If scanned character is an operand, push it onto the stack. 

Step 3: If the scanned character is an operator Then 

a. Pop the two top elements a and b from the stack where a is the 
top element and b is the next to top element. 

b. Apply the operator on the operands b and a and push the result 
onto the stack. 

[End Loop] 

Step 4: Set Value = Stack[Top] 

Step 5: Print: “The value of the expression is”: Value 
Step 6: Exit 


















The calculated result i.e. 38 of the expression P i 8 retum ~ - "-~ 

4.4.2 Matching Parenthesis 

A stack can be used for syntax verification of the arhw,- 
for each left parenthesis in the expression there is a 1 ' Xpressi<m for ensuring that 
accomplish this task of parenthesis matching, the exn^ dmg right Parenthesis To 
character by character. Whenever a left paSnfteS “ Scanned fro “> wK 
stack. The parenthesis encountered can be of any type T pnsh ft 01110 

curly brace {. When we encounter a right parenthesis 1 or 1 T* [’ round braoe C or 
checked. If the stack is empty then we have a right narenth Z L' “* status of staok is 
not have the corresponding left parenthesis in the expression 1 ** ex Pression that does 
expression. If the stack is not empty, we will pop the topmost .° wmg mist ake in the 
compare it with the scann^^ 

type then it shows a mistake m the expression. But, if both the paienthe*s JTtfZ 
same type then the same procedure is repeated until the whole expression is scanned 
stack is empty. 

Algorithm: Syntax verification by scanning an arithmetic expression 7' from left to 
right character by character using a stack. 

Step 1: Scan the expression / from left to right and Repeat Steps 2 to 4 for each 
scanned character until the end of the expression is reached. 

Step 2: If the scanned character is left parenthesis then push it onto the stack. 

Step 3: If the scanned character is an operator or operand then ignore it. 

Step 4: If the scanned character is a right parenthesis Then 

a. UStack[Top] = Null Then 

Print “There is no left parenthesis corresponding to right 
parenthesis”. 

Exit 

[End If] . .. 

b. Pop the top element from the stack and compare it with currently 

scanned right parenthesis. 

c. If both are not corresponding Then 

Print: “The braces are not in proper order . 


Step 5: 


[End Loop] 

Ifttncfc [Top] * Null Then corresponding » «* * 

Print: “There is no rigm f" 


Exit 
[End If] 


Print: “There is no 

parenthesis”. 
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Exit 


to Data Structures 




[End If] 

Sup 6: Exit 

Explan ution: 

In the syntax verification algorithm, we are interested in parenthesis matching cr.lv, ^ 
we execute the loop in the first step while scanning the given infix expression from 
right until the end of the expression. 

Within this loop, we check for the elements of the expression (i,c operands, cpcra?.:n 
left brace, right brace etc.). If the clement scanned is left trace we push it into the rjdc 

As we are not concerned with the operators and operands in this algorithm, so we ip--: 
these in step 3. In step 4, we check, if the clement of ‘he expres sion i« the right brace then 
wc check: 

If the stack is empty, wc conclude that there is no left ->co corresponding to right bn,\* 
and exit from program 

If stack is not empty then we pop the fop mo- left * re ''.*, ;>c and compare it 

with currently scanned right brace. If both the Inf* 5 ! - - ‘ *: ;;e not correspond 

we conclude that braces arc not in proper order an i -, ' ■ ;;rsn; The aNh e V\ 3 , 

and 4* steps arc repeated within the loop 

The loop is finished when the expression ends and euiudr :: - loop m step 5, wr chew 
whether the stack is not empty, If so. wc conclude that chert is no right brace 
corresponding to left brace m ihc expression and c.xi: from the pro gam._ m 


Let us check the order of braces in an arithmetic expression / . sin g above algorithm. 
/ = [(5 + 6) x 7 - (7/4) + (3 x 2) - 0| 


Character Scanned 

Statu* of Stack 

( 

Ll 

( 

(( 

) 

[ 

( 

—-—___1 

f f 

2 J 

i t 

-i | 

i ( 

1 1 ! 

c 

-i— - 1 

Null 


i 
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ut us take another example with an arithmetic expression: 


Stack 


Scanned Character 

' " V— v T U 

Status ot Stack 

( 

( 

{ 

l { 

( 

~~ ( ( ( - 

[ 

rm ■ 

( 

i({([( 

) 

({(t 

( 

( t < t < 

) 

({(t 

) 

({( 

) 

(( 

( 

({( 

) 

({ 

} 

( 

( 

c ( 

( 

((( 

) 

c ( 

) 

c 

) 

Null 
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4.4.4 Recursion 

Recursion is very important and powerful tool for developing algorithms for various 
problems. Recursion is the ability of a procedure either to call itself or calling to some 
other procedure which may result in call to the original procedure. In computer science, 
solution of many problems can be best defined recursively. Two very important 
conditions/requirements that must be satisfied by any procedure to be defined recursively 


are: 


• There must be a decision criterion that stops the further call to the procedure 
called base criteria. 

. Each time a procedure calls itself either directly or indirectly, it must be nearer 
to the solution i.e. nearer to base criteria. 

A procedure having these two properties is called^tefme^ variourprogramming 
defined recursively. Recursive P roce *“f?L lan JLs are not able to handle recursive 

languages but compilers of some programin g m required by the recursive 

procedures because they do not have s ALGOL C, and C++can be used 

procedures. Programming languages such as PASCAL, ALGOL, l, 

to implement recursive procedure calls. 

44.4.1 Examples of some Recursively defined problems the factorial of a 
Most of the readers may be familiar with procedure “ 1 prob Iems can 

Positive integer or finding the n ,h term of a Fibonacci sen 
be defined recursively. 
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symbol) next to it in . x (n-1) x n 

n ! = l xz ^° , | , . 

„ . + _v Pn as 1 Let us now calculate the 

The value of the factorial fimction for zero is taken as 

factorial of some positive integers. 

31 = 3x2x1 = 6 
4 ! = 4 x 3 x 2 x 1 = 24 
5! = 5 x 4 x 3 x 2 x 1 = 120 
6! = 6x5x4x3x2xl = 720 

The factorial for the same numbers can also be defined as: 

4! = 4 x 3! 

5! = 5x4! 

6! = 6 x 5! 

Thus, the formal definition of factorial function can be given as: 

if n-0 

n '~ tn x (n - 1)! ifn> 1 

This definition of calculating the factorial of a number is recursive as it meets both the 
conditions which are required to solve a problem recursively. 

Using the above stated definition of the factorial, we can calculate the factorial of any 
positive integer. Let us compute 5! using the recursive definition of the factorial. This 
computation will be accomplished recursively as shown below: 


Step 1 
Step 2 
Step 3 
Step 4 
Step 5 
Step 6 
Step 7 
Step 8 
Step 9 
Step 10: 
Step 11: 


5! = 5 x 4! 


4! = 4 x 3! 


3! = 3 X 2! 


2! = 2 x 1! 


1! = 1 x 0! 


01=1 


41 = 24 


31 = 6 


21 = 2 


11 = 1 


5! m 120 

to compute the Value of 4 "^ n '?u e ™ so ^. 4! ' So > ,0 compute the value of 51, it is i ,ec “ s *2 
the value of 41, it is necessary m c™™, 8 ^?’ 41 ,' S defmed “ terms of:31. So, to con V* 
similar manner. In the sixft stoTT? Value of 31 • Steps 3 to 5 are defined 

tep> we have reeohed the base criteria of the "cul^ , 
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f this problem. So, we can explicitly use the value of 0!. In step 7, we use the 
compete the 1!. The step 8 to step 11 will be defined in the similar manner 
yiloe rf 0 £ gte p ii, the value of 5! is computed recursively. 

Calculate the value of n! recursively 
factorlaKn) 

Ifn * OThcn 
Set Fact = 1 
Return 

EbC set Fact = nx Factorial(n- 1) 

Return 
[End If) 

Fibonacci Series F F 

a _ f numbers which is usually denoted by F 0 , F v 
A Fibonacci senes is a sequence of n 
f p 31 . ,F n . The series is as shown below. 

0,1,1,2,3,5,8,13,21,. f+F F 4 = F 2 + F 3 and so on. 

Here,F 0 = QJt = 1 and F 2 = F 0 + F i> F 3 = 1 2 ’ * ^ i§ a sum 0 f two 

Generally speaking, in a Fibonacci senes, ZtX+Z* of <he F.bonacc, senes 

preceding terns. The recursive procedure for findrng 

can be defined as: ^ n _ q or 1 

mo(n) = - » + mo(n ' 2) , Jill. 

Algorithm: Find the n th term of a Fibonacci sen 

Fibonacci (n) 
lf n * OThen 
Set Flbo = 0 
Return 

Ifn = IThen 

SetFibo = 1 
Return 

EUC . + Fibonacci^ ' 2) 

s «Fibo * Fibonaccl(n - 1) + 

Return 
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TT^ .he example of finding the 4* t«n of the 
followed for it is shown below m the figure: 

0 


F«1 


c?}*- 

J—► F. = 1 


Fibonacci series 


>1 



ry 

P -1 



1 


*c 




F 0 =0 




1 


Recursion in Finding the Term of a Fibonacci Series 

To find the 4 th term recursively, it is necessary to find the 2 nd and 3 rd term first Audi 
turn to find the 3 rd term, it is necessary to compute the 2 nd term and 1 st term first. Toi 
the 2 nd term of the series, it will be required to find the 1 st term and 0 th term. By using, 
values of 0 th and 1 st term explicitly and backtracking the steps followed, we can finch 
4 th term of the series. 

When to Use Recursion 

Recursion is generally used for repetitive computations in which each action is defracdin 
terms of previous result. 

procedure ^ther^ ; f eci f on a ^ 01dt w ^ ether to use recursive procedure or non-recuisive 

that affect the choice nf ^ ^ a ? d fast m * e tlie selection. There are many facto® 
mat affect the choice of procedure for solving a given problem: 1 

• Computer Memory Required 
Processing Time Required 

is for a givoi |m*| em IftteUK 

Demerits of Recursion 

recurs, 0 n. Hence fl 
‘ion time and !l!L plemen,ed usin * r0C ! 
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Data Structures 



1. 

2 . 



3. 


4. 


5. 


6 . 


7. 


8 . 

9. 

10 . 
11 . 


Exercise 

What is stack? How it is different from other linear data structures? 

What are the basic operations performed on stack? Explain the underflow 
overflow condition of the stack. ^ 

How array representation of stack is different from linked representation? 

Explain various notations that are used for expressing arithmetic expressions. 

Convert the following infix expressions into their equivalent prefix and pojtgg 
expressions. 

(a) a x b + (c + d) - (e + /) + g x h / k A 2 

(b) b + c x d-e + (e*2 x f) 

(c) (a x b x c A 2 + d) + (c / d + c) 

Sort the following list of numbers using quick sort. 

5 90 72 20 25 100 50 70 

What is recursion? What are the factors on which the choice of a procedure to solve 
a given problem depends? 

What are the demerits of iterative methods? 

Write an algorithm to implement a stack using array. 

Write down the algorithm of quick sort. 

Write down the algorithm to verify the syntax of an expression. 


I ii 


(Question, from variou. Universities previous F..n.i.. % n ,) 


1 • Discuss any three applications of stack with suitable examples. 

2. Write an algorithm which uses recursion to determine the factorial of an integer. 

3. Explain with suitable examples the different operations that can be perfonned on » 


4. Otange ead. of the following infix expmssions to porifirc 


b. A + B . C + (D . E + F) . G 

c. A- B - c 


5. What if the utility of stacks in function calls? 
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6 . 


7. 


Stack 


following expressions to pref.x and postfix notations 
12 - 4 * 5 A 3 
b . ((12 — 4 ) * 5) A3 

What is the complexity of Quick Sort in average and worst case? 
g Write a procedure to convert infix expression to postfix expression? 

9 Write an algorithm to implement the stack using the linked list. 

0 what is a stack? What are the various operations possible on stacks? 

! \ What is a recursion? What are its drawbacks? 

12 Explain about infix, prefix and postfix notations. Write an algorithm to convert infix 
expression to postfix expression. 

13 Write an algorithm for sorting an array with the help of quick sort. 

14 . Discuss the complexity of quick sort algorithm. 

15 . Explain the terms overflow and underflow. 

16. Explain the importance of Reverse Polish notation with example. 

17. Explain the implementation of stacks using arrays. List some of the applications of 
stack. 

18. Consider the following arithmetic infix expression Q . 

Q: 1 + (2 * 3 - (4/5 * 6) * 7) * 8 

Convert Q into its equivalent postfix expression P. 

(Multiple Choice Questions) 

1. An algorithm that calls itself directly or indirectly is known as 

A. Sub algorithm 

B. Recursion 

C. Polish notation 

D. Traversal algorithm . re j s n0 available space, 

2-When new data are to be inserted into a data structure, u 

this situation is usually called 

A. underflow 

B. overflow 
C- housefull 

saturated . ^ 

^hich of the following name does not relate 
FIFO lists 
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B. topi + top2 = MAXSIZE 


Stack 


g Following is C like pseudo code of a function that t*\,« 
uies a stack S to do processing. kes a numbe r as an argument, and 

void fun(int n) 



{ 


Stack S; // Say it creates an empty stack S 
while (n > 0) 

{ 

// This line pushes the value ofn%2 to stack S 
r>ush(&S. n%2V 


} 


push(&S, n%2); 
n = n/2; 


} 


) 

//Run while Stack S is not empty 
while (!isEmpty(&S)) 

printf("%d ", pop(&S)); // pop an element from S and print it 


What does the above function do in general? 

A. Prints binary representation of n in reverse order 

B. Prints binary representation of n 

C. Prints the value of log n 

D Prints the value of log n in reverse order 

9 Following is an incorrect pseudo code for the algorithm which is supposed to 
determine whether a sequence of parentheses ,s balanced. 

declare a character stack 
while (more input is available) 

{ 

read a character 

if (the character is a'(') 

push it on the stack . not empty) 

else if (the character 1S J,? ^ 

pop a character off the stacK 

6186 print "unbalanced" and exit 

} 


print "balanced" j Qes the above code think is ba 

Which of these unbalanced sequences do 
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Consider the following pseudo code that uses a stack 

* declare a stack of characters 9 

while (there are more characters in the word to read) 9 

read a character * ;9 

push the character on the stack |1 

while (the stack is not empty) 9 

pop a character off the stack 
write the character to the screen 

What is output for input “geeksquiz”? 

A. Geeksquizgeeksquiz 

B. Ziuqskeeg 

C. geeksquiz 

D. ziuqskeegziuqskeeg 

11. For the expression ((A + B) * C - (D - E) A (F + G)), the equivalent Postfix notation 
is 

A. AB + C*DE-- A FG + 

B. AB + CDE--*FG + A 

C. AB + C * DE - FG + - A 

D. AB + C*DE--FG + A 

11 For the=xp re s Sl0 „(( A + B) * C - (D - E) A (F + G)), fl* equivalent Prefix noWiollil 

A. - * +ABC - DE A + FG 

B. A - * +ABC - DE + FG 

C. A - +AB * C - DE + FG 

D. A - + * ABC - DE + FG 

U T*^T UCtUre “ US * d 10 perfonn recursion? 

B - Linked List 

C. Stack 

D. Circular Queue 
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Chapter 5: Queue 


5.1 Introduction 

Queue is ft special kind of linear data structure. As discussed in the previous chapter, 
stacks restrict the insertion and deletion of elements only at the top end. Similarly, queue 
is also a restricted data structure because the new element can be added at its one end 
known as rear of the queue and the element can be removed from the other end known as 
front of the queue. We all are familiar with the concept of queues we usually make as 
these are the part of our daily life. We wait in queues for our turn at the ticket counter of 
railway station, bank, post office, bill deposit counter etc. 



People Waiting in a Queue 

. . otmrtiire as it has various applications in programming 
Queue is a very important data structure as 

(system programming as well as application programming . 

In this chapter, we will start “ion enqueue "e 

5.2 Queue d known 

Queue is a linear collection of elements in 

M tear and deletion takes place at another end taown ^ queu e. Ttats 

°f a queue are processed in the same order y elements of a 8 en 

queues are also known as FIFO (First In First OutlUst. 

^ueue are processed on first come first serve asi ( 
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5 3 operations on the Queue 

two basic operations which are performed on queue ar 


• Insertion 

• Deletion 


• UCiCUUU „ 

, 0 f a ne w element at the rear of the queue 

The insertion operation ref “* *°? j when queue has space to accommodate % 

Insertion operation can be y isert an element in a queue having no spate 

new element. The condition of attempting to inset twe 

results m a state called overflow^ of an elem ent from the front of the queue. 

othon operation can be performed only when the queue is not empty. The condition of 
“ng delete an element from the empty queue is known as underflow condthon 

Consider a list of four elements (a, b, c, d ) where a is the front element and d is the ten 
element. The queue of these elements can be represented diagrammatically as shown in 

figure below: 


a — b - c - d 

ynjin-r-Y 


Front Rear 

A Queue with Four Elements 

New element e will be inserted at the rear end in the given queue after the element d as 
shown in figure below: 



Queue after the Insertion of a New Element 


CpHZHZl-E] 

Front I 


Front I 

Ut us delete another element fromT* ° f *" Element 

lookliteMtho^n^.“1! queue - The^uIaferXed f*•** fr ° nt e “ d ° f Tm 
own m figure below: ttcr 1112 deletion of front element b W 
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Queae after the Removal of another Element 

5.4 Memory Representation of Queue 

Just like stack, computer programming languages do not have i„ k„ii. 

-mcttire. Thus similar to the stack, the queue can be renresent.a I! b " dal> 
rn way or a linked list. Representing the queue using M ^fim D “^ 0ry ^ means of 
m "» *• »»y. Array mpres^tion ofqueu^aSb 17,^“ 7 

state of the queue’s length (maximum size) can be made prior to^e exIcutaTT. 
program. The linked list representation of the queue is more suitable if accurate 
of the queue’s size cannot be made in advance. Let us discuss both the repr esentation s of 
the queue in computer memory one by one. 


5.4.1 Array Representation of Queue 

Representing queue using array is very simple but array puts some restrictions while 
representing the queue in memory : 


• The elements that are to be inserted into the queue must be of same type 
(Homogeneous). 


• One must specify the upper bound of the array i.e. maximum size of the queue 
must be defined before implementing it. That is, queue represented using array 
is confined to the space allotted to that array. Generally, queue grows and 
shrinks overtime but an array has constant size. 


• While representing queue using array, it is programmer’s responsibility to 
enforce the First In First Out (FIFO) order. 

Me implementing queue using array, we need to use two variables Front and Rear 
keep track of beginning and end of the queue. However, implementation of queue 
ing array is not straight forward as in the case of stack. In the array implementation ot 
lc k> insertion and deletion is restricted at the one end of the array, ere ore, 

^ents of the stack occupy only the front part of the array whereas in queue, the 

etnents are inserted at the rear end of the queue and deleted from the^frori d of^ 

lcue ‘ So, if the last position of the array is occupied then it wi no 

0re dements even though some front positions will remain vacant in the q • 

0I jJ| dcr 40 example of a list of 5 elements that is maintained by x 0 f the 

Qd two variables Rear and Front The variable Front contains £ ^ * 

at front end of the queue and the variable Rear conta 
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£ 22 £—-- e . initially, the elements of the list ate 

dement at the rear end of the queu 

array as shown below. , 3 * S « 7 


Front 


Array Representation of Queue 

1 io inoArtpH into the queue, the value stored in the variable 
whlfbelncremented by one and element will be stored at the rear end of the quene. 
in the above example,^ new element / will be inserted at mdex 6 as shown below: 

if a h 



Front 


Queue after Insertion of Element 

If we want to insert another element say ff, it will be inserted at index number 7 as shown 


below: 



Front 


Queue after Insertion of Element 'g' 

Now, let us delete the element from the queue, the only element which is at the front of 
the queue can be removed and variable Front of the queue will be incremented by one. 
If we delete an element from the queue Q shown in above figure, then after deletion, the 
queue will look like as shown belowi 


Front „ 1 

Rear 

If we want h i Q, “' ,e Remov » I #f »» Element 

below: * 0I “ more elemeM > to after deletion, the queue will be as 


sho®* 


1 cn 
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Queue after Removal of another Element 

Now, we want to insert a new element h into the queue Q when the queue is occupying 
last portion of the array i.e. when the variable Rear has attained the upper index of the 
array. Here, one way to handle this situation is to move all elements of the queue to the 
front positions of the array and reset the values of the variables Front and Rear. 

No doubt, we will get the free location for inserting the new elements at the rear end, but 
Ibis is an expensive operation as after every deletion, all the elements after deletion 
position will be shifted to left by one position. Another efficient way to handle this 
situation is to treat the array Q as circular, it means that the element Q[l] comes after the 
element Q[7] as shown in figure below: 

l 



Front ■ 3 
Rear *7 


A Queue Maintained in a Circular Array 

With this consideration that our array is circular, the ” e * J* b “i^till 

reset to the value 1. Similarly, if after the s mnvimum limit i.e. 7, then after 

Si £ Zlnttt ^ be reset ,01 ^ of 

While implementing the queue using array ^ 

°»it. we will treat our arnty Q (queue) as circular i.e. 01 J 
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Algorithm: Insert a new element ‘Data' into a queue. The size of the Queue b y 
i.e. 'n' number of elements can be accommodated in the Queue. Here, lower index li 
taken as '1' and upper index is taken as 'n' 

Step 1: If Front = 1 And Rear = n Then 

Print: “Queue is Full, Overflow Condition” 

Exit 
[End If] 

Step 2: If Front = Rear + 1 Then 

Print: “Queue is Full, Overflow Condition” 

Exit 
[End If] 

Step 3: If Rear = Null Then ( 0? K (? uU i ^ r! n ^‘' ! 

Set Front = 1 And Rear = 1 
If Dear = n Then 
Set /tear = 1 
Else 

Set Dear = Rear + 1 
[End If] 

Step 4: Set Q[Rear] = Data 
Step 5: Exit 
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^conditions for inserting an element into the circular queue am shown beIow; 

* a^Kear 


Queue 



14T 


Front 


Front “ 1 
Rear - n 
Queue ia Full 



Front = N«U 
Rear a Nnll 
Queue ia Empty 


Front^ 



Rear 


^ Front 

Front - Reartl 
Queue is Full 


Next 



iront 

Rear a n 

Element will be inserted at index 1 


Rear 


Normal Q««« Rear + l (i.e. 2 hem) 

Element will be inserted at in 
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flffed Approach to Data Structures 


Explanation: 

In the above algorithm, we first check the overflow conditions i.e. the queue jg ^ 
foil. The steps 1 and 2 are the conditions of checking the queue being foil. If a J jy7?j 
condition in step 1 or step 2 becomes true then the element cannot be inserted into oiif 
so we exit from the program giving an appropriate message. ^ 

If none of the conditions in step 1 and step 2 are true, we move to the step 3 which cheek 
three different conditions In sequence. 1 * * 

The 1 st condition If Rear = Null, indicates the empty queue in which element Dot* 
will be inserted at index 1. ^ 

The 2 nd condition If Rear = n, indicates that the Rear variable has been reached at^ 
last index so the next empty position in the circular queue is 1, so the element Data hu 
to be inserted at index 1. w * 

The 3 rd condition indicates that the element Data is to be inserted into the next to the 
Rear index. 


In step 4, we insert the element Data at the Rear index 


Algorithm: Delete an element from the queue 


Step 1: If Front = Null Then 


Print: “Queue is Empty. Underflow Condition” 
Exit 


[End If] 

Step 2: Set Data = Q[Front] 

Step 3: If Front = Rear Then C5 .>,.- «• ,x.> 

Set Front = Null And Rear = Null 
Else If Front = n Then 
Set Front = l 
Else 


^ A-JL 


Set Front = Front + \ 
[End If] 

St ep 4: Exit 
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** -ZAZT- “ el "“ M fr ° m **“ **>" are shown 




Front ■ Null, Rear ■ Null 
Queue is Empty 

Front 


Front ■ 3, Rear ■ 3 
After Deletion, Front 
and Rear ■ Null 


Null 



Rear-*. 



-Rear 

Front - n 

After Removal of an element 
Front will be set to 1 


Normal Queue 

After Removal of an Element, 

Front will be Incremented by 1 


nation: . • emDt y by using the 

shove algorithm, l“ of all we eheck «or flw queuej ^ ^ .icm.ntca.be 

)n if Front - Null This is because, if th ^. s ing an appropriate messag • 

from the queue and we exit from int0 a variable Data for future us • 
"step, we store the Front indexed element tnto ^ w n 

a used to check three different conditions In seque_ 
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Th e i* condition, 1 {Front = Rear indicates - 

After deletion of this only element, the Front and Rear ’variables will be set 
The 2 nd condition is used to check whether the variable Front has reached 
index. So, after deletion, the variable Front will point to index 1, a 
set Front = 1. The 3 rd condition simply increments the value of Front 


5.4.2 Linked List Representation of Queue 


An alternative and efficient way of representing queues is by using linked list. The 
advantages of such a representation over array representation are similar to those of 
linked list over the array. Linked representation of queue can be represented 
diagrammatically as shown in figure below: 



A Queue Maintained using a Linked List 

Here, two pointer variables Front and Rear contain the addresses of the elements at the 
front and rear end of the queue respectively. Initially, when there is no element in the 
queue, both its pointers Front and Rear will have value A full indicating an empty 
queue. 


The insertion of a new element e in the above shown queue can be shown as in figure 
below: 



This insertion of an element V in the 


New 


queue 
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Front - Front—► Next 


Deletion of an element from the Queue 

Here, the front element a has been deleted. So, the variable Front will point to the 
address of element b next to the deleted element. The algorithms for the insertion and 
deletion of the elements in the queue are as follows: 

Algorithm: Insert a given element 'Data' in a queue which is implemented using a 
linked list 'Q' having variable 'Front' which contains the address of 1 st element of 
the queue and variable 'Rear' which contains the address of last element of the 

queue. 

Step 1: If Free = Null Then 

Print: “No Free Space Available for Insertion” 

Exit 
[End If] 

Step 2: Allocate memory to node New 

Set New = Free And Free - Free -» Next 
Step 3: Set New -> Info = Data And New -* Next = Null 

Step 4: If Rear = Null Then 

Set Front = New And Rear = New 


Else 

Set Rear -> Next = New And Rear - New 


[End If] 
Exit 


toplanation: . . t u e free storage 

n the above algorithm, l“ step is used to cheek ^appropriate message will be 

jft. If free storage list does not contain any free node then an appj>_ 

l, "~' yed and exit from the program. ^ 
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AStom 



l, fi 1 Data Structure 




Step 2: 
Step 3: 


allocated 

to^2-»tep, a new none.» m~~~- ^ *„« in the Next pm n m 

pu «mg the element Data mi the Info u empty (j.e*ear 

step 4 , the condition is chec J ked; '^ i^variable Front and Rear both. 

. . 

Algorithm: Removes an dement from^ the address of i« element of 

-..I.. i" 

Step 1: If Front = Afull Then 

Print: “Queue is Empty” 

Exit 
[End If] 

Set Data = Front -» Info, Temp = Front 
H Front = flear Then 

Set Front = Null And Rear = Ntri/ 

Else 

Set Front = Front -» Next 
[End If] 

Deallocate memory taken by node Temp 
Set Temp-* Next = Free,Free = Temp 
Step 6: Exit 

Explanation 

q"e*« notTrto lynode/elemem ** C ° ndition of the empty qU *f' ^ 

and exit from the program. then a PP ro P riat e message will be display 

If the queue is not empty then in the 2 nd «*u , ,. ^ 

vanable Data for future use. The add™. *?.' ** element of the 1 * node is stored » ** 

In the 3 rd sten the «n*A- 4 i • ° node is st °red in the variable Temp- 

emmvr r f* ear)the n both the ^ variaWe Fr^ linked list is having only one node 

rs 1 *“ unk ^ fiear « - *«« ***201 

deellocted dre88 of 2 node (From node then “>« Fron VH^ 

111 la step 5, the node Tettfr 


Step 5: 
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^ So me Special kinds of Queue 

to we have discussed about the queue in which elements are processed in FIFO 
^Insertion and deletion of the element was restricted at the two ends (roar and front) 
aueue. But, there are some other kinds of queue which have some specialty while 
°\f rming the insertion and deletion operations. These special kinds of queue are: 

Deque (Double Ended Queue) 

# priority Queue 
. Double Ended Priority Queue 

5 5.1 Deque (Double Ended Queue) 

ui Glided aueue is the linear queue data structure in which insertion and deletion 
Do ®7 “ ^ n 0 t restricted to one end but rather insertion and deletion operations can be 
operations TheS e operations cannot be performed at any other 

ends of the list. Deque data Structure is also known as Deck. The 

representation of deque data structure can be shown diagramraatu-ally as. ^ ^ 

i a 5 6 7_8_ l _ 10 ■ 11 ■ i i I 1 "~1 


end 1 


end 2 


Deque with 7 elements 

. m use two variables endl and end2 

Instead of using the notation of Front and Rear we-e ^ ^ ^ eithet 

to represent the index of the two en s deleted either at endl or endl. 

atemtl or endl. Similarly, the element can be delete >t index 3 or „ 

In the above shown deque, the insertion of new ele 10 can ^ deleted, 
index 11. Similarly, the element present at index 

A deque can be categorized into two categories 

• Input Restricted Deque 

• Output Restricted Deque t ion is restricted to one end but the 

h case of Input restricted deque, the ^ertion P ^ 

deletion can take place at either end of restricted to one end 

!" case of output restricted deque, the deletion opera 

'Mertion can take place at either end of 
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<M Priority Qaww 

rr3s-2£=a^i 

. The elements with higher priority are processed before the elements with b* 

priority. I 

. In case of elements with same priority, elements are processed according toft* 
In First Out (FIFO) rule. That is, the element with same pnonty willfe 
processed in the same order in which these are inserted mto the queue. 

Priority queue can be represented into the memory in various ways. The three main w „ 
to represent a priority queue are: 

• Priority queue using linked list 

• Priority queue using multiple queues 

• Priority queue using heap structure 

5.5.2.1 Priority Queue Using Linked List 

In the linked list representation of priority queue, each node of the linked list is divided 
into three parts as shown below: 


m 

Info (holds Priority Next 

the element) (holds the (holds the 

priority number address of 

of the element) next node) 

Info Part holds the element of the queue. 

Priority Part holds the priority number of the element. 

Next Part holds the address of next node of the linked list. 

T—. 1 • < 41 . 
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p , 


L-* pfT - 

K tl. 1 1 +• • 1 ♦ +* ‘ 5 IX 


Queue 


\* iis insert an element k with priority 3. This element will be inserted as die 3 rd 

jfoW, lcl ^ . *- j -«-t-.t— 


N de'ie between the node r and g as shown below: 



urn 


let us insert an element s with priority 2. This element will be inserted as 3 ri node 
(^between the node r and k) as shown below: 


H71 1 \ 3 ^ 


mu 


h 5 


E 


element m with priority 4. This element will be inserted as 6* 


t ne insert one more 

^ (Le. between the node g and h) as shown below: 



k 3 




m 


7 rtie linkedlist representation of priority queue, the 
During the deletion of a S list. Here, in the above shovm 

element can be deleted from the eg nro cessed deleted from the queue is P 
priority queue, the only ele, "' nt t “ -“ of *e linked list. Only after the deletion o 
priority 1) as it appears at the begmn g 
element p, we can delete the element r and so o . 


-- r 7 

So, after the l #t deletion, the priority queue will e. 


ms 



After deleting another element, the priority qu 
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jli fied Approach to Data Structures 

5 5.2,2 Priority Queue using Multiple Queues 

Priority queue can be implemented using multiple arrays in the form of multini 
In this representation of priority queue, a separate queue is maintained fo ^ Ueue $. 
elements with same priority level which follows the general FIFO order. These r ^ ^ 
queues may be circular queues for its efficient use and will also have separate vaili 
Front and Rear. While using multiple queues representation of priority 
following information must be known in advance, ^ Ueue s, 

• The maximum number of priority levels (so that maximum number n f„. 

queues may be known in advance). ° f 1 ^ 

• The maximum number of elements with same priority (so that maximum size 

each queue may be known in advance). °‘ 

Let us suppose that we have maximum of 5 priority levels (i.e. priority 
number 1,2,3,4, and 5) and maximum of 4 elements with same priority. So, the priority 
queue can accommodate maximum of 5 x 4 = 20 elements. Elements with priority p 
are inserted in the respective queue of priority p according to FIFO rule whereas the 

elements can be deleted according to the priority of the element (starting from the 1“ 
queue onwards). 

Following is the representation of priority queue using multiple queues: 

12 3 4 

n 



Priority queue representation using multip 


After insertion and deletion of L 

representation will be: Allowing elements in sequence, the results 


Insert p with priority 3 
Insert n with priority 5 
Insert g with priority 3 
Insert s with priority 4 
Insert m with priority 3 
Delete an element 
Insert k with priority 4 


Insert d with priority 3 
Delete an element 
Insert frwith priority 2 
Insert i with priority 2 
Delete an element 
Insert r with priority 1 
Insert v with priority 2 
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Priority 

1 

2 

3 

4 

5 


Front 

1 

2 

3 

1 

1 


Rear 

1 

3 

4 
2 
1 


12 3 4 

B=m 

Fbl llvp 

[plfe lml dl 

kin i i 

norn 


5 5 2.3 Priority Queue using Heap Structure 

Heap data structure can be used to implement priority queue. Let us define the heap 
before discussing its use in implementing the priority queue. 

Heap (Max heap) is the almost complete binary tree data structure in which every parent 
element is larger than or equal to its child elements. 

Min Heap is the almost complete binary tree data structure in which every parent 
element is smaller than or equal to its child elements. 

Similarly, if the smallest element is our highest priority element then we can process ,« 

using Min Heap. „ hean structure will be discussed in detail in 

Both the insertion and deletion operations on heap struc 
the chapter of Tree data structure. 


Scanned 




























5.5.4 Applications of Priority Queues 

There are many applications of the priority queue in system programming as well as 
application programming. 

• In case of a time sharing systems, where different jobs are to be processed by the 

same processor, priority queues are used by the operating system to manage ® 
processes. If the operating system of the computer implements the> shoi ? s * ^ 
first policy then in that case, a shortest job wiil £ 

longer job i.e. shortest job will be given & £T. 

operating system. The different jobs waiting P 

priority queue. . 

• Priority queue can be used to manage ^andwuhh ™ * can be halted to 

network router. In case of limited bandwid h all other q 

send the traffic from the highest priority que • n «« t edlv 

• Priority queue can be used in Huffman codims efficient, 

obtain the two lowest-frequency trees. A priority q rica , 

• Priority queue has its applicat 10 ” ,n ” e “’ ^Computational number theory, 
computation, data compression, graph earchmg, 

artificial intelligence, discrete optimization 


5.6 Applications of Queue 

There are many programming situations where the queues can be used verv 
Some of the applications are listed below: 

• Queue is used to access the shared resources e.g. printer queues 

• Queue is used as buffer between the fast processor and slow input/o tn 
devices. 

• Queue is used to implement multiprogramming concepts. 

• Queue is used by the operating systems for process management. 
Queue can be used as components for the other data structures. 


I 


li 


S router llSed “ bU£fer “ Uaky bucket algonthm t0 contro1 *e flow of dal,*; 
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Exercise 


1 

2 


What is queue? Explain the similarities and differences between stack and queue. 


Explain the basic operations performed on a queue. Also explain the 
overflow conditions in a queue. 


underflow and 


3 What are different ways of representing queue in memory? Which one is better and 
why? 

4 What is deque? Explain the types of deque. What is the benefit of using a deque 
over the simple queue? 


5 What is priority queue? Write down the applications of priority queue. 

6 Explain the memory representation of priority queue. 

7 What is circular queue? Explain its applications. 

8 Write an algorithm to insert and delete a node from a circular queue. 


(Questions from various Universities previous Examinations) 

1. What is a queue? Discuss the need for circular queue and show with example how it 
is implemented? 

2. List the applications of queue. 

3. What is a circular queue? Explain with an example, howts -mplemented? 

4. How is a circular queue implemented using 

a. Array b. Circular linked list. 

5. What is deque? List its different types of deque. ^ a queue of queues? 

6. How would you implement a qu^e of smcks, a s ^ of these dam 

Write routines to implement the app p 

structures. . 9 

7. Wbuaihsi^of&oma^*"P° llrter '“ , 

e nn, 

9. Compare the stack and queue data Wfjte m algorithm to insert an ite 

10. What is difference between stack an q« rfd an 

into a circular queue. array' Write *j* \ 9 circuit 811(5 

element at the front and 
discuss the boundary con i 
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A Simplified Approach to Data Structures 
12. Explain the general structure of queues with the help of block diagram. 


(Multiple Choice Questions) 

1. Which data structure allows deleting data elements from front and inserting at rear? 


A. Stacks 

B. Queues 

C. Deques 

D. Binary search tree 


2. Identify the data structure which allows deletions at both ends of the list but insertion 
at only one end. 

A. Input-restricted deque 

B. Output-restricted deque 

C. Priority queues 

D. None of above 


3. A data structure where elements can be added or removed at either end but not in the 
middle 

A. Linked lists 

B. Stacks 

C. Queues 

D. Deque 

4. Which one of the following is an application of Queue Data Structure? 

A. When a resource is shared among multiple consumers. 

B. When data is transferred asynchronously (data not necessarily received at same 
rate as sent) between two processes 

C. Load Balancing 

D. All of the above 


5 ‘ if £ like pseudo code of a function that takes a Queue as an argument, 

uses a stack S to do processing. 

void fun(Queue *Q) 

Stack S; // Say it creates an empty stack S 
//Run while Q is not empty 
while (!isEmpty(Q)) 

^ push^deQue«(Q))" 6 andpush ,he dequeued item to S 
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//Pop an item from S and enqueue thepoppped item to Q 

enQueue(Q, pop(&S»; v 


What does the above function do in general? 
a Removes the last from Q 
3* Keeps the Q same as it was before the call 

C. Makes Q empty 

D. Reverses the Q 

6 Suppose a circular queue of capacity (n — 1) elements is implemented with an array of 
n elements. Assume that the insertion and deletion operation are carried out using 
REAR and FRONT as array index variables, respectively. Initially, REAR = FRONT 
_ o -phe conditions to detect queue full and queue empty are, 

A. Full: (REAR+1) mod n == FRONT, empty: REAR == FRONT 

3 ’ pull; (REAR+1) mod n == FRONT, empty: (FRONT+1) mod n == REAR 

C. Full: REAR == FRONT, empty: (REAR+1) mod n == FRONT 

D. Full: (FRONT+1) mod n == REAR, empty: REAR = FRONT 

7. Consider the following operation along with Enqueue and Dequeue operations on 
queues, where k is a global parameter. 

MultiDequeue(Q) 

{ 

m = k 

while (Q is not empty and m > 0) 

{ 

Dequeue(Q) 
m = m -1 


What is the worst case time complexity of a sequence 
°n an initially empty queue? 


of n MultiDequeueO operations 
(GATE CS 2013) 


A. 0(n) 
b* ®(n+k) 

C. ®(nk) 

D. @( n 2 ) 



A* Insertion 
Deletion 


^ Retrieval 
D * Traversal 
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Chapter 6: Tree 


6.1 Introduction 

So far* various linear data structures like array, linked list, stack, and queue have been 
discussed in detail in the previous chapters. 

In this chapter, we will discuss a non-linear data structure called tree which is mainly 
used to represent the data having hierarchical relationship among them. The tree data 
structure is also termed as parent child relationship. To understand the concept of tree, 
consider a simple superior-subordinate relationship among the employees of a software 
company. The tree structure of the employees’ hierarchy is shown in below figure, where 
the lines connecting the nodes represent the superior-subordinate relationship between 
the employees. 


p 



A Tree Showing the Hierarchy of Employees In a Company 
P_ President SVP-Senior Vice President 

VP-.Vlce President PM— Project Manager 

PL-Project Leader SE-Software Engineer 


tree, binary search tree 
associated with each of these trees 


In this chapter, we wil 
associated with tree. T 
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0.2 Tree 






A General Tree 


* •» i rce 

^ es ® node ^ ** edge or branch * AI 

c - or more children callJnJT ^ associated vv ^ «• A node ir 

cai.ec , leaf node or terminal node Sometimes*!**** 880 ! 1 *’ A node having no chl! 
nodes and non-terminal nodes as internal n^LT ™ 3 n0deS 316 referred •» «» 
IKX ' e ^ ^ D0V '' n »s siblings or brothers. * n a * ree » nodes having same p£ 

Is figure given above j ; e »i, 

“i Br.and By ’ " ** "« of *• »e having three childlen or succ< 

B 2 , and B? are sibHnoc 

Similarly. D t .D t are the^bl^ ^ <!' ? PaWM ** *- 

A Path between any two nodes have no child - 

; ^ connected bv the edaea TK» Se<,uence of distinct nodes in « 

• -. _ s. any Other node m the tree ifir^, 1 ^ ? usl be " actl > one path betwee 
f“ *“ ,s “« a W* but a graph ' * m0re *■» one path between any two n 

* ne kngth of a path in tree is tn* 1 

Ttert exists a path of lemr* ^ °* ***** Wbicb come acr <>ss that path. 

P«h from root node A to node d' ; ”*2 "° d t'° itSelf 10 «* «* shown in fig 

1 "* D 2 which is of length 3. 








Tree 


loht of any node in a tree is the length of thT\ ----- 

T H b nal «° ie - The helgh ‘ f T' iS trea,ed as h2u,f* ? om * a ' ■><** '» a 

ier0 L the node Bt ,s a ' a J? e1 ^ \ Similarly, the nodes C, and r* the tree show " in 
"height of the tree is 3. The height of all the leaf nodes is 1 “ e “ hei 8h' 1- Here, 

Hegree of node can be defined as number of child nodes it h,c . , * 
legtee zero. In *e tree shown in figure, the node d has degree j 

weight of the tree ts the number of external nodes available in that tree x s ,w 
r.mal nodes are known as leaf nodes, so the weight of the tree k aI I A ^ 
"umber of leaf nodes m that tree. In the tree shown in figure, the weight of the tree™ H 
here are 11 leaf nodes in the tree. 11 

In a tree, each node is assigned a level number which comes from the length of the path 
from the root node to that node. Root of a tree is said to be at level 0. The level (also 
.'vm as depth) of any node is the number of edges that are to be travelled from the root 
node to that particular node. The tree shown in figure below describes the level of 
nodes in the tree. 


The 

has deg ree 
degreej 

The 



6.3 Binary Tree A 

^ important category of general trees is binary tree. A binarytreecan^ ^ ^ or 
J nite collection of nodes where each node is having the property a spec i a i node 

2 children. A binary tree may be empty known as null tree or it c ^ n g^ t binary 

Ca [ led r oot of the tree and remaining nodes in the tree °™ 1 figure below: 

Subtr *s. The diagrammatic representation of a binary tree is shown 
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A Binary Tree 

Here, the node A ts the root of the binary tree which is at the top ot the hee.Biandfi. 
Z the left and nght subtrees of the root -4. wh.ch m turn are the roots of the left and 
right subtrees respectively. The left subtree of the root is having nodes 
B v C v C 2 , D v D 2i and D 3 . The right subtree has the nodes B 2 , C 3 , D 4 , and D s 

One main thing to notice is that each node in the tree is having not more than two 
children. 

Similar Binary Trees 

Two binary trees are called similar if both are having similar structure but the elements in 
both the trees can be different. Similar binary trees are shown in the figure below: 
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Equivalent Binary Trees 

Tuo binary trees are said to be equivalent or comes if • •, 

^ contents m their respective nodes. P they are Slm,lar an d are having the 





Fig.: a 

The trees in figure-a and figure-b are equivalent binary trees as both are having same 
structure as well as the contents of respective nodes are same. But, the trees in figure-b 
iad figure-c are not equivalent as the contents of both the trees are different. Also note 
that all the three trees in figure-a. figure-b, and figure-c are similar binary trees. 

Complete Binary Tree 

A Kinarv tree is called complete if it contains the maximum number of nodes it can have. 

»* almost complete if all Us levels are fall except the las. one. 

AlmostComplete and Complete Binary trees are shown in the figures belo . 




Fig.: b - A Complete Binary Tree 


2 ° = 1 node. x _ ^ 

At level 1, maximum number of nodes can = 4 , 
At level 2, maximum number of nodes can e 
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—t.fied Appr " >,,h nata SlruUU ^ 

strictly Binary Tree lf aI , the non leaf nodes of the tree Ujh , 

A binary tree is called r ? t " C f/.^^non-leaf node of the binary tree contain, ^ 
exactly two children. That is. e . known as 2-tree, or full binary (r *^ 

ngh , subtree. A strictly binary tree with n.eaf nodes' 

sonrettmes estende ^ ^ „ shoW n below: 



A Strictly Binary Tree 

A strictly binary tree is different from a complete binary tree in the sense that in complete 
binary tree, all the leaf nodes are at the same level. 

6.3.1 Properties of Binary Tree 

• A binary tree with n nodes has exactly n - 1 edges. 

In a binary tree every node except the root node has exactly one parent 

• n a nuuy tree, there is exactly one path connecting any two nodes in the tree 

• T L e i: mUranUmber 0 fn 0 deS -^-eofheigh, Ais/t + l. 

example. height * * 2 a+1 - l F « 

er Of nodes in a binary tree of height 4 will be 2 4 * 1 - J s 31 

. ^ mber 0 neafn 0 deS,nacom P lete binary tree is &± 1 > 

to a complete binary tree 2 ' 

Number of external nodes = N „ 

Urn er °f internal nodes + I 
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<2!Vleinory Representation of Binary Tree 

' jfV tree can be represented into the computer memory using two wavs Th. „„„ 
and efficient way to represent a bmary tree is linked represen Jo„ which“ 
‘Similar to the was as linked lists are represented into the memory. The other wav 
is also called sequential representation, uses array to store the elements of bin^ 


tree- 

6 3 2,1 Linked Representation of Binary Tree 

The most general way to represent a binary tree into the memory is linked representation, 
this representation, each element of the tree is represented by a node having three 

parts: 

t The 1** part (Info) is the information part which stores the element. 

• The 2 Bd part (Left) stores the address of the left child node. 

• The 3 rd part (Right) stores the address of the right child node. 


In this representation, a pointer variable Root is used which contains the address of the 
root node of the tree. If the binary tree is empty, then the variable Root will have value 

Null stored in it. 
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The nodes having no left and right child will have Null values stored in the (respect-. 
Left and Right pointer part. 

The information part of the node may have more than one items stored in it. Consider s 
want to store the records of the student using a binary tree. Each record has three neids • 
name, age, and course. The structure of the node will be as shown in the figure oc«l •• 



TTTTT 

Left Name Age Course Right 
Structure of a Node used to Store Three Items 
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when a new ‘ s t0 be ' ns «n«l into the binary „« - - — 

free pool «">,ch ts mamtamed «* raemo^ a“„ B ■ taken from 

%s has its own pointer variable Free, wh,ch L^l T 2? trees ™ s f '“ pool of 

“the P ooL T r hese free nod « are connected us mathe “ ° f ^ f,rst free nCKie 
nodes as shown in figure below: g the P 01nl er field Right of the 







an 

-c 


mm 

H 


mm 

H -1 


Null 


I 1 








Left Right 
List of Free Nodes 

6J.2.2 Sequential Representation of Binary Tree 

It is also possible to represent a binary tree using array. This representation is known as 
sequential representation. In this representation, the root of the tree is always stored at the 
1 st array index and its left and right child will be stored at 2 nd and 3 rd indexes 
respectively. In general, if a node of the binary tree occupies the k th index of the array 
then its left child will be stored at (2 x k) th array index and its right child will be stored 
at (2 x k + l) th array index. The sequential representation of a binary tree of height h 
will require an array size of 2 h * t - Kapproximately 2 h *‘)- Consider a binary tree 
shown in figure below: 
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43678 9 10 11 12 

Array Representation of the Binary Tree 

a being root of binary tree is stored at 1 st array index. So, its left child b 
2 nd array index and its right child b 2 occupies 3 rd array index. As b 2 is* ?" CUpies 
3 rd index, its only right child c 3 occupies (2x3 + l) tft i.e. 7 th array index Si^ at 
the element d 1 being left child of element c 2 at index 5 occupies (2 x 5) t/l j e ^ 
index. 

It is to be noted that in the sequential representation of the binary tree, nia 
positions are vacant. So, this array representation is efficient only when the binary 
complete binary tree or nearly complete binary tree. ' ree ' s 

6.3.3 Operations Performed on Binary Tree 

Various operations performed on binary tree are: 

• Traversing the Binary Tree 

• Finding the Number of Internal and External Nodes in Binary Tree 

th '“ operalions on binary tree, we are assuming that binary tree j. 

matmamed in the memory us.ng the linked list representation. 0 

6.3.3.1 Traversing the Binary Tree 

Traversing is the process of visiting each node in the tree Wh^n . • . 

entire collection of nodes is visiiew ” me tree * When a 11,66 1S traversed, its 

binary trees, these are: are hree standard methods for the traversal of 

• Pre-Order Traversal 

• In-Order Traversal 

• Post-Order Traversal 

While traversing a binary tree, following three 

• Visiting the root 

• Traversing the left subtree 

• Traversing the right subtree 
Above listed activities arp 

different traversal meT^l"”* « ^ren, orders when tree is traversed usu# 

diagram for 


main activities take place: 


uitterent traversal methods mentions < 7 ltferent ord ers when tree is tr 
reversing the tree through different traversal'methods^*^ ** follow “8 
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A Binary Tree 

Let’s explore each tree traversal method one by one: 


Pre-Order Traversal 

In the pre-order traversal (also known as depth-first order), first, we visit the root then 
recursively perform the pre-order traversal on the left subtree and then perform the pre¬ 
order traversal on the right subtree. This traversal method is also known as Root-Left- 
Right traversal. In this method, traversal order followed is: 

• Visit the Root 

• Traverse the left subtree in pre-order traversal 

• Traverse the right subtree in pre-order traversal 

The pre-order traversal of the tree shown in above figure will result in the following 
processing order: 

a J&! Cj d 1 c 2 d 2 d 3 b 2 c 3 d 4 c 4 d 5 


•Order Traversal 

the in-order traversal (also known as symmetric order), firstly, w ^ e ^ t^eiTrfeht 
versed recursively in the in-order traversal then the root is Mri 'nght 

■tree is traversed recursively in the in-order traversal. > s 

>wn as Left-Root-Right traversal. In this method, traversal order . 

* Traverse the left subtree in in-order traversal 

* Visit the root 

* Traverse the right subtree in in-order traversal _ 

in-order traversal of the tree shown in above figure will result 
order: 


Ci b t d 2 c 2 


c 3 d 4 b 2 ^5 c4 
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»-■* rss**, ««s ss.»- —^ "*■ * 

follows: nost-order traversal 

. Traverse the left su tree r( j er traversal 

. Traverse the right subtree in post or 

. Visit the root above figur e will result in the tallowing 

The post-order traversal of the tree shown 

processing order: fc d, c 3 <*s c * * 2 

d, c, d 2 “s C2 u th . left subtree is always traversed 

In all the three traversal m h between th e traver traversed before 

before die right In the r ‘ a ^f !s Iversed between the 

S3-"*? 

ssr/.i—> *» •r~ ir>>inM rf .„*— 

-rr —Tn e. a * 

sarsarsis - «• - - ^ 

stack data structure to implement other traversal techniques. 

Algorithm: To traverse a binary tree T In the pre-order manner 

Step 1: If Root = Alu// Then 

Print: ‘Tree is empty” 

Exit 

Else 

Set Pointer = Root 

[EndIf] na ble 

Step 2 : Initialize an empty stack by pushing Null into it and the stacN 
Top with 1 

Step 3: Repeat While Pointer * Null 


oy 


Step 4: Print Pointer -> i n f Q 

s; te p 5; If Pointer D/-L. 



Tree 


incrementing stack’s 


[End If] 

Step 6: H Pointer -> Left * Null Then 

Set Pointer = Pointer Left 

Else 

Set Pointer = Stack - Top 

Decrement the stack’s variable Top by 1. 

(End If] 


[End Loop] 
Step 4: Exit 
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Else 

Set Pointer = Root 

[End If] 

Step 2: Initialize an empty stack by pushing Null into it and the stack variable 
Top with 1 

Step 3: Set Flag = True 

Step 4: Repeat Steps 5 to 10 While Flag = True 

Step 5: Repeat Steps a and b While Pointer * Null 

a. Push Pointer onto the stack and increment the stack variable 
Top by 1 

b. Set Pointer = Pointer -* Left 

[End Loop] 

Step 6: Set Pointer = Stack -+ Top 
Step 7: Decrement the stack variable Top by 1 
Step 8: Set Flag = False 

Step 9: Repeat While Pointer * Null AND Flag = False 

Print: Pointer -► Info 
If Pointer -+ Right * Null Then 

Set Pointer = Pointer -* Right 
Set Flag = True 

Else 

Pointer = Stack -> Top 

Decrement the Stack variable Top by 1 
[End If] 

[End Loop] 

Step 10: If Pointer = Null Then 

Set Flag = False 
[End If] 

[End Loop] 

Step 11: Exit. 
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£Spl* nati ° n: 

I the variable Root holding the address of root node is tested first, if it has Null 
1° ste ^ e n it means tree is empty and we will exit from the program. On the other hand, if 
' a ^ U< ariable Root holds the address of root node, a variable named Pointer is set to the 

node of the tree. 

^ em pty stack is initialized by pushing Null onto the stack and setting the 
^ ^variable Top to 1. In Step 3, variable Flag is initialized to True. Step 4 is a loop 


exit 


• tpns 5 to 10 which continues) till the variable Flag is True Loop will be 
5^endie value of Flag becomes False 

C ,u, addresses of all the nodes starting from the root node are pushed onto the 
11 S ^rill the extreme left leaf node is reached. Thus, for this, the variable Pointer is 
advanced towards left by storing the address of left child of current node in it. 

, „ . on reaching the extreme left where Pointer has attained the value Null, the 
b nter is reinitialized by popping the address of extreme left node from the top of the 
In step 7 we have popped one address from the top of the stack and stack vanab e 
Sis decremented by T In step 8, the variable Flag is set to False for temporarily 
stopping the push operation onto the stack. 

In step 9, a loop is used for popping the addresses from the top of the stack one by one, 
till Null is popped from the stack. 

from the stack does not has right child, Pointer is set to the node by popping an address 
from the top of the stack. 

In this loop of step 9, nodes will be popped and ^pusT operarionwill 

a node having right child is popped and accessed fro ’ True 

restart again by resetting the Pointer to address of right child and Flag 

to step 10, the address contained in the Pointer variable is tested. If it holds a Null 
value then Flag is set to False and process is stopped^ 


Algorithm: To traverse a binary tree T In the post-order manner. 
Stepl: If Root = Null Then 

Print: “Tree is empty” 

Exit 

Else 


ouailMUU Lty oamouaiiiiei 












Sri Point * 1 


(I'ml If) 

step2 . . . . * . ..*<*‘ ^U Iopt 

Step 1 Set Flag * Tru # 

Step 4 Repeat Step" 51<> "> w,lll< ' ' “ Tru * 

Step 5: Repeat While Pointer * Hull 

I'uhI. Point ft onto I hr atm k »»i<l »m rnmrii! thr *u«.k 
by I 

If Point et * Mfll'l * Null I hen 

PurIi Point? I * III ft hi on Hark end Increment 

variable Top by I 

[End If] 

Set Point or Pointer' *l<cft 

[End Loop] 

Step 6: Set Pointer • Stack -* Top 

Step 7: Decrement the stuck variable Top by I 

Step 8: Set Flap m False 

Step 9 Repeat While Pointer * Null AND Flap * False 

If Pointer > OThen 

Print Pointer -»Info 

Set Pointer « Sfaefc Top 

Decrement the ntuck vuriublc Top by 1 

Else 

Set Pointer - -Pointer 
Set Flag m True 

[End If] 

[End Loop] 

!; I Stepl0; If Pointer ■ Null then 

Scl h iu » - False 

[End If] 

[End Loop] 

Step If. Exi( 
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, . . rr ^ c h.oD a taSm g- 

„, h jjstored into the memory usmg the 

node ,s s,ored m a pom,er vanable Root 
representation and ad - p re -order manner recursively. 

/Algorithm: To Traverse a binary 

HeePreTraversaKBoot) 

Ml: B»~< ‘ »«™" 

Print: ‘Tree is empty 
Return 

Else 

Print Boot -»/»/° 

[End If] 

Step 2: lf*«* - *•/» * A,M “ Then fm 

Call RecPreTraversal (Root -> Left ) 

[End If] 

Step 3: If Root -» Right * Null Then 

Call RecPreTraversal (Root -* Right ) 

[End If] 

Return 



Explanation: 

In step 1, the variable Roof holding the address of root node is tested, if it has Null 
value then it means, the tree is empty and control is returned back to the calling prop a - 
On the hand if variable Root has the address of the root node then the contents ot roc * 1 
node are accessed. 

In step 2, the root node is tested for having left child, if Root node has a left child then 
address of this left child is passed to recursive function RecPreTraversoii) 1 
traversing the left subtree of the root node in pre-order. 


hi step 3, the root node is tested for having right child. If Root node is having a ^ 
ch,ld ,h en address of this right child is passed to the recursive fo®* 0 " 
RecPreTraversaK ) for trav ersing the right subtree of the root node in pre-wdg 

Algorithm: To traverse a binary tree In the In-order manner recursively. 
RecInTraversal (Root) 

Stepl: If Root = Null Then 

Print: “Tree is empty” 

Return 





Step 


Step 3: 
Step 


Step 5: 


[End It] 

It Root - Left * Null Then 

Call ReclnTraversal (Root - Left ) 

[End If] 

Print: Root -* Info 

{{Root -* Right * Null Then 

Call ReclnTraversal (Root Right) 

[End If] 

Return 


Explanation: 

In step 1, variable Root holding the address of root node is tested. If it has Null value 
^ it means, the tree is empty and control is returned. 

ten 2 variable Root holding the address of root node is tested for having left child, if 
th 5 Root node is having a left child then address of this left child is passed to recursive 
function ReclnTraversal { )for traversing the left subtree in in-order manner. 

In step 3, after traversing left subtree of the root node in in-order, the contents of root 

node are accessed. 

. „„ , variable Root holding the address of root node is tested for having nght child. 
H Ti* toZ a right child then address of this right child is passed to die recursive 
L. J \lJnTraversal( )fot traver sing the nghi subtree of the root node in m-or 

Algorithm: To trovers, a binary tree in the Post-order manner recursively. 

RecPostTraversal (Root) 

Step 1: If Root = Null Then 

Print: ‘Tree is empty" 

Return 
[End If] 

Step 2: If RootLeft * Null Then 

Call RecPostTraversal {Root -» Lef 

[End If] 

St ep 3: If Root -* Right & Null Then 

Call RecPostTraversal {Root -* 9 

[End If] 
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to Data Struct^ 

Print: Root -*info 



Step 4: 

Step 5: Return 



Explanation: 

in Step 1 variable Root holding the address of rootnode: istested. If it has Null Hltc 
‘ then a message will be displayed and control will be returned. 

In step 2, variable Root holding the address of root node is tested for having left child. [ f 
me mot node ,s having a left child then address of this left child is passed to the recurs,' 
function RecPostTraversalQfor traversing the left subtree in post-order. 

In step 3 variable Root is tested for having the right child, if the root node is having a 
right child then address of this right child is passed to the recursive function 
RecPosttraversal( ) for traversing the right subtree in post-order. 

At last in step 4, data contained in the Info part of the root node is accessed and 
displayed.^ 


63.3.2 Finding Number of Internal and External Nodes in Binary Tree 


As mentioned earlier, the nodes which do not have any left and right child are said to be 
external nodes or leaf nodes. All the other nodes having one or two children are said to be 
internal nodes. To find the number of intemal/extemal nodes in a tree we have to traverse 
it. For this purpose, we can traverse the tree using any of the three (pre-order, post-order, 
or in-order) traversal methods. During traversing the tree, each node will be tested for its 
number of children. If it has any child then it will be counted as internal node, otherwise 
it will be counted as external node. The algorithm for finding the number of 
intemal/extemal nodes is given below: 


Algorithm: To count the number of internal and external nodes in a binary tree 
using the pre-order traversal. 


Step 1: 


Step 2: 

Step 3: 
Step 4: 


If Root = Null Then 
Print: “Tree is empty” 
Exit 


Else 

Set Pointer - Root 

[End If] 


Imbafee an empty stack by pushing „„„ ^ ^ ^ ^ s(ack van 

Initialize the variables Internal -hah 

Repeat While Pointer , Nult ' ° Ande * te ’™' = <> 
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onto the stack by incrementing stack 


Step 5: 
Step 6: 


a. If Pointer -» Right * Null Then 

Push Pointer -> Right 

variable Top 

[End If) 

b. If Pointer -> Left * Null Then 

Set Pointer = Pointer le/t 
Set internal = Internal + 1 

Else 

If Pointer -* Right = Null Then 
external = external + 1 

Else 

internal = internal + 1 
[End If] 

Set Pointer = Stack-* Top 
Decrement the stack’s variable Top by 1 
[End If] 

[End Loop] 

Print: “Number of internal and external nodes are: , internal , externa 
Exit 


Explanation: . . w .» 

In step 1, variable Root holding the address of the program else a Pointer is 
value then it means that the tree is empty and we exit from progr 

set to the address of root node. WuH in the stack and setting the stack 

In step 2, an empty stack is initialized by pus > n B and ex t e rnal for counting the 

variable Top to I. In step 3, two variables to Q 

internal nodes and external nodes respective y are pointer is having 

in step 4, there is a loop which repeats its actions l 

some valid address (no Nu(() value contained m l • . the right child. If* 

Instep 4(a), current node (first time the root node^stest^ or ^ ^ sta ck by 

has the right child then address of that ngh c _ -—- 

incrementing th^variabUTori. 


CdlllIUU uyOciii iouciiii iei 









•• 



1 


. ^uwsSSSSSSSS. 

I h | 11 f 1111 I is K V “ ,W “S *“ —-- ,iav mg left 

^^iT^ln er ,s advanced by atonng the address of left oh,Id i„ it N 
,[ has a left child. Polnv er d 0n t he other hand, if the current node do P , 

variable internal is also in else block of this step for having th e rj 

Lve any left child, the control will f'[ intemri is incremented else the 7J. 


not 

have any lett cnuu. the^ ^“' v " able internal is incremented else iht 3 ' 

child. If it is has a ngh oh « stored onto the top of the stack is poppe(j '' 
external is incremented^ ^ stage , Pointer will have either Null „ 

assigned to the variable PO • ^ - n be tested j„ the loop condition of step 4 

address of some node in it T jf the pointer is holding some not Null 

- »»“•“" — * ““ “ *” *•■“» 

assigned to the variable Pointer . 

* tu* innn the value of variables internal and extevnal is 
In step 5 after coming out the loop, me vaiuc 

printed. 1 " " "" - 

6.4 Reconstructing Binary Tree from its Traversals 

ta the last 

and e posMrd°er wversal of a binary tree then we can construct the binary bee from te 
given traversals. Consider the pre-order and m-order traversal of a binary tree gi 

below: 


In-order Traversal : gdbheiafc 

Pre-order Traversal : abdgehict 

Here, we will construct the binary tree from these traversals. As in pre-order tr ^ vcrsa ^ 
first element is always the root of the tree. So, the root of the binary tree is fl - 
determining the root of the binary tree, we have to find the nodes which will torm e 
subtree and the nodes which will form the right subtree of the root. In in-order tra\ e 
the root of the tree lies between the nodes forming left subtree and the nodes forming * 
right subtree. Therefore, after looking at the node a in the in-order traversal, we find # j 
the elements g, d, b, h, e, l form the left subtree and the elements f, c form ^ 
subtree. The separation of elements forming the left subtree and right subtrees are ^ 
below: 
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^ s iage, the partial tree can be constructed as shown below: 



„ \ e next stage, we will construct the left subtree with the elements of the left subtree 
\ose m-order and pre-order traversals are given below: 

In-order Traversal : g d b h e i 

Pre-order Traversal: b d g e h i 

nalvzmc the pre-order traversal, b is the root of the left subtree and after looking for 
h dement b in m-order traversal, we find that the elements g, d form the left subtree 
dthc elements h, e, l form the right subtree of the tree rooted at b as shown below: 


Inorder Traversal 


g 


|# Left Subtree^ T H-Right Subtree—H 


Root 



|+ Ufl Subtr„*H—RightSuWre, ►! 


Root 

At this stage, the partial binary tree can be constructed as shown be 



I--- f node b whose in 

following the same procedure for the left subtree o 

Os t-order traversals are: 


in-order 


and 
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In-order Traversal : g 

pre-order Traversal: d 

From the pre-order traversal, d is the root of the subtree and looking for this c| e 
in-order traversal, we find that the element g form the left subtree and there is no^ 
in the right subtree of the element d as shown below: e,1,eni 


Inorder Traversal : I 6 


Left 

Subtree 


T 


Root 


I Preorder Traversa] : 

M 

LZJ 

f Left 


Root 


Subtree 


At this stage, the partial binary tree can be constructed as shown below: 



'jj b* 

Now, the left subtree of the node b has been constructed. The same proceduj^ 
applied to the elements e, h, i which belongs to the right subtree of the node 


in-order and pre-order traversals are as under: 


In-order Traversal : h e l 



the right subtree as shown below: 
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J Preorder Traversal :l e 

l-l 

1 « 1 

f Uft 


I Subtree Right 
Root Subtree 


^ thlS sta gc, the binary tree will look like as shown in figure below: 



traversal is: 

In-order Traversal : 
Pre-order Traversal: 


/ c 
c / 


rre-oraer i nvenwi «- / f y.: c 

f this subtree and looking for this 
Here, from the pre-order traversal, c is t e roo subtree and there is 

element m in-order traversal, we find that the element f form 
no element on the nght of element c as shown below. 


Inorder Traversal 


Left 
Subtree 


Root 



Root 
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Similarly, we can construct the binary tree from its in-order and post-order 
traversals. 


Let us construct the binary tree from its in-order and post-order traversals. 

In-order Traversal : 5 10 12 15 18 20 25 30 35 40 50 

Post-order Traversal : 5 12 18 15 10 25 35 50 40 30 20 


As in post-order traversal, the last element is always the root of the tree. So, the root o* 
the binary tree is 20. After determining the root of the binary tree, we have to find the 
nodes which will form the left subtree and the nodes which will form the right subtree or 
the root. As we know that in in-order traversal, the root of the tree lies between the nod^ 
forming the left subtree and the nodes forming right subtree. Therefore, after looking 

the node 20 m the in-order traversal, we find that the elements 5, 10, 12, 15,andl&fc^ 
the left subtree and the elements 25, 30, 35, 40, and 50 form the right subtree Tfc* 
separation of elements forming left subtree and right subtree are shown below: 



Right Subti 


Scanned by CamScanner 







L he rartul tt* « <* constructed as shown f lgure bdow; 


Tree 



„* next stage. *■* *i» construct the left subtree with the elements of the left subtree 
u <•> in-order and post-order traversals are: 

la-order Traversal ! 

post-order Traversal : 

B\ anah^ng the post-order traversal. 10 is the root of the left subtree and looking for the 
dement 10 in in-order traversal, we find that the element 5 form the left subtree and 

. i ^ i 1 fiTrm flit* noht ^lihfr^t* nf trpi* rnnfpH 10 qc eV»Aum KaIau/- 


5 10 12 15 18 
5 12 18 15 10 


Inorder Traversal: 

5 

10 

12 

15 

18 

K ■■■H _T 

Leff Root 
Subtree 


n Right Subtree ' 

j Preorder Traversal :| 

dJ 

FI 

[taj 

LuJ 

M 


Subtree 


At this stage, the partial binary tree can constructed as shown below. 



a 10 whose ® 

tjW-hg the same procedure for the right subtree of the node 
border traversals are: 


in-order 
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A Amp lified Approach to Data Structures 

In-order traversal : 12 15 18 
Post-order traversal: 12 18 15 


From the post-order traversal, 15 is the root of the subtree and looking for thn ,j„. 
in in-order traversal, we find that the element 12 form the left subtree a,vj „ 


mm m ~ - W 

form the right subtree of the node 15 as shown below 


Inorder T raven*a 1 : 

M 

15 

hi] 

H — M 

1 l*o 

Subtr** 

f 

P/ar/t 

K H 

So bt/#a 

Preorder Traversal : 

12 

18 

1 ir * 


T*ft* 

lUifhi 

i t 

Root 


S>J bt/99 Subtree 

The partial binary tree at this stage can be constructed as shown below: 



traversals are: * w * 11UUC ls rcma,n >ng whose in-order and p*' J 

In-order Traversal ; 

Post-order Traversal : 

* - TV ou 

rom th® post-order traversal i 

in-order traversal, we find that elemJ^^r f thlS subtree and looking for this eh 
form the right subtree as shown below ^ ^ 0rm tbe ^ su l Jtr ee and elements - - 


25 30 35 40 50 
25 35 50 40 30 
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The partial binary tree at this stage can be constructed as shown below: 



traversals are: 

In-order Traversal 
Post-order Traversal 


35 40 50 


35 50 40 

From the post-order traversal, 40 is the root of this subtree an( j element 50 forms 

iB-order traversal, we find that element 35 forms the left 
the right subtree as shown below: 

Inorder Traversal ^ 35 | 40 

hleft * Root' Right 
Subtree Subtree 



Left Right 
Subtree subtree 
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6.7 An Application of Binary Tree(Huffman Algorithm) 

A \ er> goou practical application ot binary’ tree is in compression techniques. Let us 
the Huffman codes that are used to compress (encode) the characters of a file 
L.iMaer a p.oblem ot encoding tin binary) a text message which is composed ot 
a pna ts or num rs. The encoding is done by the computer system and the code used 
hw? k ASC11 ' Amencan Standard Code for information Interchange) 
reo'ese'nted bv th/1 t0 St0re " ch charact 'r e g character A (ASCII value is 65) ■ 
9') is represented by m^Tete 111 10 by 0100000l > cfamcttr a (ASCII value » 

are just ^ bUS f ° r each charact er) to represent the text then 

the characters so that most frequently^ because We °° uld ^ variable length codes » 
bmar> code of length lesserfle« th ' characters in the text could be gi ven 

This technique of using the variable^ tban ^ Iess frequently occurring characw - 

file and hence uses the memory space^ffici 00 ^ ^ ^ c * laracters reduces the size o - 

Consider a character 

Signed to these symbols (3°“tt A ‘ ®' C ' D ’ E - and F and *' ’ 

v ' ^ol 1S used for simplicity) as follows. 
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A 

B 

C 

D 

E 

F 


000 

001 

010 

Oil 

100 

101 


^ consider a text message consisting of these six symbols as ABCADFABAEF. If we 
v 'tnis text message into binarx (using above codes for each character i.e. 3 bits per 
then the code will be (000001010000011101000001000100101) of 33 bits. 

r c^xamine the above example. The character A appears in the text 4 times, the 
^Tner B and F appears for twice and other characters C, D, and E appear only once. If 
•T chosen so that the character A is assigned the code with lesser number of bits than 
V characters B and F and characters B and F are assigned the code with lesser bits than 
S characters C D and E, we can reduce the length of the encoded message to much 
Now. consider the codes assigned to above six characters as: 


Symbol 
A 
B 
C 
D 
E 
F 


Code 

0 

100 

110 

1110 

1111 

101 


F 101 

ng this code, the text ABCADF (lesser than the above encoded 

>011001110101010001111101 whose length is 27 bi 

• h\ codes for the characters used in 
** » a technique that is used to produce the varia c the tex t. This technique was 
kxt based upon the frequency of the charac er graduation. 

** ^ David Huffman in 1951 as an argument m h.s P t . 

We producing the variable codes (known as Recode for another. 

* * for one symbol must not be a father then while 
> -fthe code for o'ne symbol is prefix of die code for ^ codes for die 

2“boU from die code will result into errors, e.g- 
in the a or adz a RAFF . 


Symbol Code 
A 0 

B 100 
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onsider a text message consisting of these six symbols as ABCADFABAEF If 
thlS text message into binary (using above codes for each character i.e. 3 bits per 
^ctet) then the code will be (000001010000011101000001000100101) of 33 bits. 

re-examine the above example. The character A appears in the text 4 times, the 
Let ^ ^ F appears for twice and other characters C, D, and E appear only once. If 

°k araC chosen so that the character A is assigned the code with lesser number of bits than 
C 5 C -ters B and F and characters B and F are assigned the code with lesser bits than 
the c ters C D,and E, we can reduce the length of the encoded message to much 
fxtent. Now, consider the codes assigned to above six characters as: 


Symbol 

A 

B 

C 

D 

E 

F 


Code 

0 

100 

110 

1110 

mi 

101 


■ Will be encoded as 

length is 27 bits (lesser than the above encod 


Using this code, the text ABCADFABAEF 
OlOOUOOlllOlOlOlOOOl 111101 whose 

U riable codes for the characters used in 

There is a technique that is used to produce t e van text This technique was 

toe text based upon the frequency of the oharac e s post graduation, 

developed by David Huffman in 1951 as an ass.gntnen, tn hts P ^ 

I* producing the variable codes (known as Huffman codes ) 

** ‘I* code for one symbol must not be a .f “Uther then while 
ecaus e if the code for one symbol 1S prefix of the code tor ano^ ^ ^ for ^ st* 

s f™bols from the code will result into errors, e.g. c° 

® Iacter8 in the text ABCADFABAEF. 

Symbol Code 
A 0 

B 100 
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Here the code tor charade. B U prrfl* of the cod# of character D The binary^, 
the text ABCADFABABF is 01001100100110101000111010i. While decoding ( j 
extracting the symbols) from this code, the symbols will come out to ^ 
ABCABCFAAAFF which in not the same text as was encoded. This erroneous mess*., 

. at . I *L_.. ..aaL/^l I) It) til/* C «'l« I I V A f till* f'/wl/ft ^ I | ^ ® 


has resulted just because the code for symbol B in the prefix of the code for 


Let us examine the technique for producing the Huffman codes. I he technique u&es the 
binary tree also known as Huffman tree. All the symbols arc stored at the leaves and the 
leaves representing the most frequently appearing symbols arc closer to the root of the 

tree. 


To understand the construction of Huffman tree, consider an example text (to be 
encoded) as ABCADFABAFF f irst, we put the symbols along with their frequency 
(number of times a symbol appeared) in increasing/decreasing order as shown below; 

4 2 2 1 1 1 

A F B E D C 

Now, add the frequencies for C and D call it DC and then rerank everything so that items 

are still in sorted order ot frequency and make the partial binary tree with symbols as 
leaves. 


Initial 

1st Pass 


Initial 

■ 

< 

A 

- 4 


■ 

< 

F - 2 

F 

- 2 


F - 2 

09 

■ 

B 

-2 

■> 

B - 2 

E ■ 1 

E 

■ 1 


E - 1 

r-* «-* 

1 I 

Q U 

DC 

*2 


D - 1 

C - 1 


1st Paw 
A *4 
F - 2 
B -2 
DC -2 
E -1 
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, ^ the frequencies of DC and E and call it DCE and then rerank everything so that 

K°ms ar e in sorted order of frec l ue ncy. A 8 ain make the partial binary tree. 


Initial 
A » 4 
F » l 
B«2 
E « 1 
D » 1 
C - 1 


1st Pass 
A «4 
F * 2 
B *2 
DC » 2 
E * 1 


2nd Pass 
A =4 
F =2 
B =2 
DCE = 3 


= > 


Initial 
A * 4 
F * 2 
B = 2 
E = 1 
D = 1 
C - 1 


1st Pass 
A =4 
F * 2 
B =2 
DC =2 
E =1 


2nd Pass 
A =4 
DCE = 3 

F * 2 
B =2 




0 o 


. . ^ . fnr F and B and call it FB and then rerank 

h the third pass, add the frequencies for f reaue ncy. 

everything so that items are again in sorted older 


UitUl 

F * 2 
B « ^ 

e m 
D * 1 

C 


1st Pant 
A 
F 
B 

DC 
E 


2nd Pass 
A "4 

DCE - 3 
F - 2 

B - 3 


3rd Pass 
A -4 
DCE-3 
FB ■* 


■> 


1 


Initial 
A * 4 
F - 2 

B • 2 

E « 1 
D ■ 1 
C ■ 1 


1 st Pass 
A -4 

F -2 
B -2 
DC *2 
E - 1 


2 nd Pass 
A * * 

DCE* 1 
F " 2 
B * 2 


3rd P*»* 
A *4 
FB m * 

dce-J 


Scanned by CamScanner 




f 

l‘ N 




/T"k 


X 


c^hfied Approach to Data Structures 





in the forth Pass, add the frequencies for FB and DC£ and call it FBDCE and then rerank 
everything so that items are in sorted order of frequency. 


uttui 
A • 4 

p • 2 

B • 2 

E * 1 
D ■ 1 
C ■ 1 


It! P«i 
A • 4 
P -2 
B • 2 

DC -2 
E ■ 1 


2nd F«» 
A • 4 
DCB ■ 3 
F - 2 

B ■ 2 


3rd Pm 
A -4 
FB "4 

DCB-3 


4ik P«ti 
A -4 

FBDCE ■ 7 


Initial UtP»i 

A ■ 4 A * 4 

F ■ 2 F * 2 

B 


B - 2 
E - 1 
D ■ 1 
C ■ 1 



•2 
DC • 2 
E ■ 1 


2nd Pats 
A -4 
DCB *3 
F ■ 2 
B « 2 


3rfP*i 4UP W 
A * * FUDGE •? 

FB •* A. 

DCB* 3 



k the last pass, add the frequencies of FBDCE and A and call it FBDCE A and mate 
tull binary tree. 

2nd Pan 3rd Pati 41b Past 5th Put 

A » 4 FBDCE ■ 7 FBDCEA * 11 

FB «4 A « 4 

DCB-3 


Initial 
A ■ 4 


F < 

B 

E 

D 

C 


2 

2 

1 

« 1 
1 


lit Pa 
A * 
F « 
B * 
DC « 
E * 


A a 
DCE» 

F » 

B * 


4 

3 

2 

2 
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D 


C 



Symbol Code 


A 

B 

C 

D 

E 

F 


1 

001 

0101 

0100 

Oil 

000 


F 000 code u , „s take anoth« 

s «, no code of any symbol is prefix °* d ''J ° as follows: 

Consider a text which has frequency of characters . . « 

* A K ~~ 




36 S = 19 A = 17 


D = 14 


/ s 4 
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\ simplified Approach to Data Structures 

Here, applying Huffman algorithm to And the code* of the aymbol, Wc 


table and binary tree. 


initial 

1st Paw 

2nd Pin* 

3rd Pam* 

4th Past 

E ■ 36 

E - 36 

E - 36 

E - 3 6 

sadrz ■ ^ 

S - 19 

S - 19 

DR/ - 26 

SA - 36 

E ■ 36 

A-17 

A - 17 

S - 19 

DRZ - 26 


D -14 

D - 14 

A - 17 



R * 10 

RZ-14 







r *th p, 


<«» 


s ^0|(yi 


•in 


Initial: 


1*‘ Pass 


2 nd Pass 
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a Simplified Approach to Data Structures _ 

6.8 Binary Search Tree (BST) 



Binary search tree is a very important subclass of binary trees. I n the 


binary 


discussed so far, data in the nodes is not ordered in any logical manner. But in 
binary search tree, data is managed in such a logical way that it - n 
efficiently when required. 


case 


tree 


can be re*T of 
r ctneven 


A binary' search tree is a binary tree in which node containing the data has the foil 
constraints: ° w ' n 8 


• Each data element in the left subtree is less than its root element. 

• Each data element in the right subtree is greater than or equal to its root element 

• Both the left and right subtrees of the root will be again binary search trees 

The binary tree shown below in the figure is a binary search tree. 



A Binary Search Tree 

elements 6 ^hTTn-o^der^aversal' ofbina^ 0 ^^ h™™’ * produces a sorted list ° f ^ 
following processing order: ™ earch tree shown above will result in * 

>» 20 25 30 32 35 40 45 50 70 ,00 150 200 250 

6.8.1 Operations on Binary Search Tree 

Various operations that can be nerfnmw u- 

• SearrK' can be Panned on bmary search tree are: 

Searching a particular key element 

Inserting an element 
Deletion of an element 
Finding the smallest element 
Finding the largest element 
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^Lningt heSC °P e ™ Uo ™ on the binary searchtreTwI --I** 

jtfid .nto ^ computer s memory using the linked *“ frees are 


jj 11 Searching for a Particular Key value in BST 

k.narv search tree enables us to locate a desired element in ** 

ThC b e d to other linear data structures discussed so far” In ?K,?. e _ ff,Clem “"Was 
ca Z i element can be searched with a running time of fl n ) - "■* bee. the 

f hmart' search tree. In case, binary search tree is complete {£ b "” 8 hei e*« of 
‘‘JSTbh-y tree, the complexity of the search"* w ah »» 
^,n) Which is the most efficient search. Along with the efficiencyTnVarchm **, 
provides ease in the insertion and de etion of data elements. When comped w Sfc 

*** hSt ' ,hC , a 7 March tr ” S is b «" r both ofto t 

sorted array, we can search the element with an average running time of Ofloa.n) but 

insertion and deletion are very expensive to accomplish. On the other hand, in linked hs t 

it is easy to insert and delete the elements but searching is inefficient as there is no 

alternative of linear search which is having average running time of O(n). 


To search a particular element in a binary search tree, we start at the root by comparing 
the desired element with the value stored at the root. If both are same then the search 
procedure is stopped otherwise we follow the left or right branch depending on whether 
the given element is less than or larger than the element stored at the root node. This 
procedure is repeated recursively until we find the desired element or conclude that 
element is not present in the binary search tree. 


Algorithm: To find the position of a given element 'Item' and its parent in a Binary 
Search Tree. 


BSTSearch(Root, Item, Position, Parent ) 

Stepl: If Root = Null Then 

Set Position = Null 
Set Parent = Null 
Return 
[End If] 

Stc P2: Pointer = Root And PointerP = Null 
^ 3: Repeat Step 4 While Pointer * Null 
If Item = Pointer -* Inf o Then 
Set Position = Pointer 
Set Parent = PointerP 
Return 

Else If Item < Pointer -* Info Then 
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h,oDa.aSm,aur» 

Set PointerP — Pointer 
Set Pointer = Pointer -> Left 


Else 

Set PointerP = Pointer 

Set Pointer = Pointer -► Right 

[End If] 

[End Loop] 

Step 5: Set Position = /VuH And Parent = Null 
Step 6: Return 

Explanation: 

In step 1, variable Root holding the address of root node is checked. If it contains Null 
then the variables Position and Parent both are set to Null and control is returned. 

In step 2, the variable Pointer is set to the address of Root node and the variable 
Pointer is set to Null. Here, the Pointer is the address of current node and 

PointerP is the address of its parent node. Once PointerP and Pointer are 
initialized, the process of searching the element Item begins. 

Step 3 begins with a loop which repeats the step 4 till the variable Pointer contains a 
not Null value in it. 


In step 4, element Item is matched with Info part of the node Pointer (i.e. Info pan 
of the current node). There can be three outcomes of this comparison. The value of 
Item and Info part may be the same, the value of Item may be less than the Info part 
or the value of Item may be larger than the value in Info part. Depending upon the 
result of comparison, PointerP and Pointer are assigned values. If the element 
tem matches with the value stored in the Info part of the current node then variables 
pTl n nd Par<mtare ^signed the address contained in the variable Pointer and 
smalle^ha 165 !! 60117 ^ ^ contro l * s returned. In case, value stored invariable IteM b 
Zl er Z l e 7 S,0re . d in the ,n f° P® of the node then PointerP * 
ItemTlZ r ,hZl 7 ** °" the 0,her hand > if * he value stored in van# 

the desired element /tem?7 mat'h^ 0013 ° fStep 3 is re P eated again and again till 
becomes Null. i„ ,he fcl c ™t 7'* the ,n /° P« of some node or Poi^j 
renamed to the calling moduta ’iTa* is successftl1 and Position and Par*” ^ 
Null value without finding the A the second case where Pointer has attained 
Parent are assigned element the variables Position 

---- —and control is return^_ _ 
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^i ^JiS StSSSS. 

Set Pointer P = Pointer 
Set pointer = Pointer - Left 

Else 


Set PointerP = Pointer 
Set Pointer = Pointer - Right 

[End If] 

[End Loop] 

Set Position = Null And Parent = AritH 
Return_ 

Explanation: 

In step 1, variable Root holding the address of root node is checked. If it contains Null 
then the variables Position and Parent both are set to Null and control is returned. 

In step 2, the variable Pointer is set to the address of Root node and the variable 
Pointer is set to Null. Here, the Pointer is the address of current node and 
PointerP is the address of its parent node. Once PointerP and Pointer are 
initialized, the process of searching the element Item begins. 

Step 3 begins with a loop which repeats the step 4 till the variable Pointer contains a 
not Null value in it. 

In step 4, element Item is matched with Info part of the node Pointer (i.e. Info \ 
c c ^ en * n °d e )- There can be three outcomes of this comparison. The value 
or the fillip* f f,f rl 11 1 c same, the value of Item may be less than the Info \ 

result of c° em 7 !* Iarger ,han ,he va,ue in /n /° part. Depending upon 

P0 ' nterP ™4 winter are assisted values If the elem 

Position and Parent ^ storedIn the Info part of the current node then vanab 
PointerP respectivelv ar H 3J >lgne . t * le ad dress contained in the variable Pointer 
smaller than the value ", “h ,s / e,uraed - In case, value stored invanable /»* 
Pointer are advanced towards /"ft ^ Info part of the node then PolnterP 1 
'£* ,s ^ than the value s.oreH V* °‘ her hand ' if the value stored B ^ 

0 nter are advanced towards right e ^ n /° part of the node then Point?’ 

This action &t stcn 4 

becomes^uinrih 1 ‘7* ‘ S "“^ed^th^heV 'f repea,ed aga,n “ d 

■tSsSeZSZ,*?** de S td SeC , 0nd Case Pointer^ .wf* 

- e,emem the variables PosW 

- ^optrol is returns _ 


Scanned by CamScanner 









‘ 


^ l-jC d earlier, the complexity of search algorithm'; .. - — Tree 

ht of the binary search tree. In case hi ln a b, nary search^ ' 

H complete binary' tree, the complexity oTtZ^^ trcc is ^ZpllZb^' 
<£.)-* heij^t of complete „ r 

* e s out to be login. Foi example, if the complete binary k y? trec WUh n dements 
Of this tree is 4 which is approximately lo* 2 3i S?* 8 31 Amenta then 
ZLl maximum number ot comparison will be 5 ( c V . s ? rch for a desired 
^-31 + 1. 1° case ’ ^mary search tree has n elements th* or Wc can say 
1 L n + 1 * Wowy runn,ng timc will 


2 " ' 

h c*« *• «ry SCarCh ‘T w ;‘ h " elemems ls having heigh, equal t0 „ whlch „ the 
«0l c** of binary search tree, the runmng tune for the search process will J ?Zl ! e 

0(rt). 

6.8.12 Inserting an Element in the Binary Search Tree 
Consider a binary search tree shown in the figure below: 



... . A Binary Search Tree ^ ^ of tbe binary 

1 e Verting a new element into the binary sea ’ h ^ eve n after the 

arctl ^ must be preserved so that the tree remains a in jnserted jnt0 the given 

* ertion of new element. Consider an Item - J® . tre5i W e will hnd ** 
^ searc! > tree. Before inserting the element this task we wll J * 

position where it can be inserted. 0 * oto f the tree i e- 40 - As 
■ u Pann 8 «he given item 55 with the element at the r will P**"' ,,, »,ih 

£* (55 » * greater than the root element («£££* , 0 be 
f SUb ^ of this root node. Now, we ***»%*£*> ^ ^ 

Slue - - root of the rieht subtree ia m*' „ **1* 


dght 


: su t>tree of this root node. Now, we con*®* 1 ee this stage. 
rt i e stor ed at the root of the right subtree : nser ted is SI " J 

45 "* kft subtree as the value of element to be mse 
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*7 nt rs5 < 80). Now, compare the element 55 with the element at the 
eiemen t. As ^ element t0 be inserted is less than tl 


lament (SS < 80). Now, compare u JC — — ™ w «*ni at the r0 m ^ 
subtree i.e. with 60. As the element to be tnserted is less than the root ° 

£ < 60) and there is no left child of this root element, therefore this „ ew e| S 
* tnserted as the left child of the node having data element 60. 

the |(.,j 


ted as the left child oi me nuuc »— -.— 

It must be noted that the insertion of the new element always takes place as 

node. 



Insertion of an Element '55' into the Binary Search Tree 

So, before inserting a new element into a binary search tree, we have to find the address 
of a node which will be its parent node. After finding the address of the parent node, the 
new node can be inserted as the left or right child of this parent node depending upon 
whether its value is smaller or larger than the parent node. 

Algorithm: To insert a given element Item' into a Binary Search Tree. 

Step 1: If Free = Null Then 

Print: “No space is available for the node to insert” 

Exit 

Else 

Allocate memory to new node for insertion 

Wevv = Free And Free = Free R, ght) 

Set New Infn = , tem 

Null And New -> Right = Null 


Set New -» Left = 
[End If] 

S>e P 2: If Root = JVulIThen 

Set Root * New 
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Step - 


3: 


Exit 

[End Ul 

„Item 2 Root - Info Then 
Set Pointer = Root 1 
CM PointerP 


Right 


Step 5: 


Else 

Set Pointer = Root -> Left 
Set PointerP = Root 

[End If] 

4: Repeat step 5 While Pointer * Null 
if item > Pointer -> Info Then 
Set PointerP = Pointer 
Set Pointer = Pointer -> Right 

Else 

Set PointerP = Pointer 
Set Pointer = Pointer -> Le/t 
[End If] 

[End Loop] 

If Item < PointerP -* Info Then 

Set PointerP -* Left = JVe'*' 

Else 

Set PointerP -> = New 

[End If] 


Step 6: 



P lnatlon: . , node If the fre e 

w* l ’ ^ free memor y P°° l is checked for the j^n the mes ^ g \°[ffree 

lVai Cl h° 01 d ° es not contain an y free node i s stopped. On the other an 

°^ ee s P ace ts displayed and procedur ^ variable * ' w as 

^bt i n p00 ^ has free node then this free node is a o j n ^ 0 part of no e ^ ^ re j 

^“'wnod" 10 • the biMry SearCh l T - S aTnary search tree, so ____— 

Uk e u f de 18 inserted as a leaf node in a binary se _—- - 

'■!*? well as Right nart of the node. -—“ 
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lifted Appru^u — - 


In step 


2, the 


TIkable Root holding the address of root node of the given b„ 

Vanouiv meanS tU* rt ,x7An *taa --- 


—- . . oinarvc 

Null then it means the given tree is empty and the ^ 


*« is tested, if It contains a ^ r00t node of the tree and procedure^ *t 


have prepared in step 


•parcu v variable Root contains some non - Null. 

- - - -fis 

In step 1 it is checked whether New node is to be inserted in the left subtree or 
nghmbtree of the root node. If the value of variable Item is greater than or equal 
value stored in the Info part of root node then new node must be insened in * nfc : 
subtree, so PolnterP and Pointer are set on right subtree. On the other hand, if £ 
value of Item is less than the Info part of the root node then new node must be inserted 
in the left subtree, so PolnterP and Pointer are set on left subtree. In step 4, there «, 
loop for repeating the action contained in step 5 while the variable Pointer contains a 
not - Null value in it. 


In step 5. the value of variable Item is compared against the value stored in the 
Info part of node to which the Pointer is pointing currently. If the value of Item is 
greater than the value stored in the current node then both PointerP and Pointers 1 
advanced in right side. In the second case, if the value of Item is less than the value 
stored in the current node then both PrinterP and Pointer are advanced in left side 
After some iterations, the Pointer will attain Null value. At that moment PointerP is 
having an address of the node under which the new node containing Itemc an be 
attached either as a left or as a right child depending upon the Info part of node. 

In step 6, value of Item is compared with Info part of PointerP node. If the value of 
Item is less than the value of PointerP node then the new node is associated as the left 
child otherwise it is attached as right child with the PointerP node. _ 


Just like the search operation in binary search tree, the complexity of insertion proce« ;D 
a binary search tree is 0(/i), h being height of the binary search tree. In case, binary 
search tree is complete binary tree or almost complete binary tree, the complexity ot dtf 
insertion process comes out to be 0(log 2 n ) as the height of complete or al® c>> 
complete binary tree with n elements comes out to be log 2 n. 

wnr«f^ kfT 7 SearC ^ tree Wltb n e l eme nts is having height equal to n which L ‘ e 
0(n). CaSC ° f bmary SearCh tree ’ the mnnin 8 tin >e for the insertion will be worst * 


6.8.U Deletion of a Node from Binary Search Tree 

searching and inserton^peraftom'TheVT* 1, ^ ‘ S little bi ‘ 

binary search tree is to locate the. ^ lrst ste P f° r deletion of a given it<m- 
node. The node to be deleted from h! * contamin g the item to be removed and f 
two children. For example consider may be a lea ^ n °de or !t ma >’ have onc ' 

’ nSlder a bmar V search tree shown below: 

___ r i # ! 
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A Binary Search Tree 






, ^ n the binary search tree shown above, it is very simple to delete the leaf nodes 20 , 
y < 5 . * 0 . 92. 97. and 120. be se the only thing which is required to be done is to 

respective pointer in their parent node to Null. 

0 c the other hand, when the node to be deleted has only one child, for example the items 
.< aiK j 45 m the binary search tree showTi above have only one child, the deletion 
■oatton is still simple as the node to be deleted will be replaced by its only child node. 


w example, if we want to delete the item 45 from the tree then the node containing 45 
y jj * replaced by its child node and the tree after deletion will become as shown below: 
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pr ""e SS will proved. As it is already discuss,*, 
J^T^^fnode having no child or having only one child. The £“'« 
'^cessor'of thenod^to be deleted will be located and replaced at pos.Uon of, hen ^ 

r« s-sfTJ S KST/ 

foo toS» l 2a he »locate the in-order successor of 100. Here, the in-order succe sso "! 
o?S ,s the node containing the element 120. 



Node to 
be deleted 


Inorder 
successor 
* of the node 


Deletion of a Node having two Children 

After finding the in-order successor, we will replace the node to be deleted with its in- 
order successor. Here, the element 100 will be replaced by 120. The binary search tree 
after deleting the node containing 100 will be: 
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^—Trample in which wc want to delete a node " ~ 1 

£?&*« 30 and 45 m the binary search bee,how„ *5*,*J*— « 

“* " enwm 40 u «* -. 



Deletion of Node Containing element 40 and having two Children 

we m \iU the node containing 40 with its in-order successor node containing 42. 
Tsioarytarch tree after deletion of element 40 will be as shown below: 



[nj \y w 

Bin »ry Search Tree after Deletion of a node contain ^ ^ m s ub- 

^%rithm for deleting a given node ^ De i e teltem0- ^ here °^hild- 
^etelO and Delete*) into the mam ^ has zero or .0 

o^etelO) handles the case, when the no case. * 
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Step 3: 


If 'p^uton - Left * Null AND Position - Right * Null Then 
^-ii t\,a atoiiRnnt. Position, Parent) 


Else 

Call Deletel(floo£, Position, Parent) 

[End If] 

Step 4: Deallocate memory held by node Position 

(Set Position-* Right = Free And Free - Position ) 

Step 5: Exit 

BSTSearchO algorithm has already been explained in the previous section Refer 
sub algorithm from there. 

The sub-algorithm Deletelf) deletes a node only when the node to be deleted ha exact;; 
zero or one child node. In this algorithm, a variable Temp is used to store the zddrca 
the only child of the node to be deleted or Null value if the node to be delete: 
terminal node. 


The below sub-algorithm deletes a node having zero or one child from the b<oar> 
search tree. 

Deletel(rtoot, Position, Parent ) 

Step 1: If Position Left = Null AND Position -> Right = Null Then 

Set Temp = Null 

Else If Position -4 Right # Null Then 
Set Temp = Position Right 

Else 

Set Temp = Position - Left 

[End If] ' 

Step 2 : If Parent = JVuUThen 
Set Root = Temp 
Else If Position = p n *. 

rent -> Left Then 
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Else 


this 

:tly 

! Of 

s a 

ry 


Set 


Parent -* Right = Temp 


Step 
Tbe s 


[End If] 

Return 


, m Delete20 deletes a node having exactly two children h, thj. 
fl* iUU wo variables Successor and PSuccessor are used to locate the in n a 
«***;% parent of in-order successor of the node which is to be deleted fromt 

<*<**« SUCCeSS0 , r ^ ltS f ent „ n0d “_ are Seated, the in-order success 
utj-^ moV ed from its original position by calling the sub-algorithm Deletel(). 

jbe belo* sub-algorithm deletes a node having two children from the binary search 


Step It 
Step 2: 


Step 3 
Step 4 
Step 5 


Deiete 2 («oot, Position, Parent) 

Set Pointer - Position -> Right And PointerP = Position 
Repeat While Pointer -* Left * Null 

Set PointerP = Pointer And Pointer = Pointer -+ Left 
[End Loop] 

Set Successor = Pointer And PSuccessor = PointerP 
Call Deletel (Root, Successor, PSuccessor) 

If Parent * Null Then 

If Position = Parent -* Left Then 
Set Parent -> Left = Successor 
Else 

Set Parent -> Right = Successor 
[End If] 

Else 

Set Root = Successor 
[End If] 

Set Successor ^ Left = Position -* Left 
^Successor -» Right = Position ^ Right 
Return 


Ste P6 

Step? 
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Annroach to Data Structures 

in case of deletion process also, the running time is dependent up 0n tk " 

*narv search tree. This is because; the first step for deleting an element i. heigh ‘of . 
the desired element which has the running time of 0(h). After f lnd * Sear <^ 
element, the inorder successor of the node to be deleted is found whose n ** C 
dependent upon the height of binary search tree. Therefore, the runni ng tirT^C' 
of finding the in-order successor is 0(h). The running time complexity 0 f 
process comes out to be 0(h). In case, the binary search tree is complete 
complete binary tree, the complexity of deletion comes out to be 0(log 2lX ) 0r a K 

6.8.1.4 Finding the Smallest Element in Binary Search T 

As each node of a binary search tree is having property that its left child is smalle ^ 
right child is larger than it. Therefore, to find the smallest element in a binary search ' U 
we will have to traverse the left most node of the binary search tree. For exa 
consider a binary' search tree shown below in which 30 is the smallest element wh^f 
the left most node of the binary search tree. ' l! 




A Binary Search Tree 

Algorithm: To find the smallest element in a Binary Search Tree. 


Step 1: 

If Root = Null Then 

Print: ‘Tree is Empty” 

Exit 



Else 



Set Pointer = Root 


Step 2: 

[End If] 


Repeat while Pointer -> Left * Null 





Step 3: 
Step4: 


S,; 


Step5: 

Exit 
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f> 0 ’' ion ’ „ d check whether the tree contains any node or not. If Root = Null, 
step 1 is use otv a nd it does not contain any node. Otherwise, the tree has atleast 
V^eans .*,* Caress of this node is set to variable Pointer. In step 2, a loop is 
' £ node and m the extreme left node of the tree. When the variable Pointer 
Routed ,0 reat me left node of the tree, the Info part of this node is copied to 

,caches at the 3 ln st ep 4, the value of variable Min is pnnted. _ 

.^n able Mm -*--- 

. in, of finding the smallest element is dependent upon the height of the 
The complexity ott.no * ^ smallest element, we have to reach the extreme eft 

binary search tr • f (he ttee §0, ,f ,he height of the left leg of the 

node ° f K TdCSte wom case complexity will be 0(h). In case, the btnary search 
tree is highest th i ete binary tree with n elements, the complexity of 

finding the'smallest element will be 0(log 2 n) as the heigh, of tree in this case will be 

log 2 n. 

6 8.1.5 Finding the Largest Element in Binary Search Tree 

lie btnary search tree has property that right ^^tVwe'Ze fowverse" tie 
parent node. So, to find largest element a ^ p i e , in the binary search tree shown 

tree along the node of the tree, 

below, the largest element is 7 5 which is me & 



A Binary Search Tree 

nt in a Binary Search Tree. 

Algorithm: To And the largest e em 
Ste Pl: If Root = Null Then 

Print: “Tree is Empty 
Exit 

Else 
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A Simplified Approach to Data Structures 

Se: Pointer = Root 

;End If] 


w .'W m « 

Repeat while Pointer Right * Null 


Set Pointer = Pointer -* Right 


'End Loop] 

S:er 3: 

Set Max = Pointer ->Info 

Step 4: 

Print: Max 

Step 5: 

Exit 


Explanation: 

executed ,o reach a, the extreme right node If Z1 In s,e P 2, a loop „ 

reaches a. the extreme nght node of the tree Z h “ 1)16 Vanable P °‘”"r 
^.able Wax tn step 3. In step 4, the value ot^bkM^p^l 10 

The complexity of finding the largest • j 

searcc tree. .As in finding the largest element we h '? end '’ nt Up °” ** he * ghl ofthe binary 
*e tree starting from the root ofthe tree So if the h reac . h ,he extreme right node of 

omn , WOrS ' case “mplex.ty wm b ^A^'r" of tha ^ght leg ofthe heels 

complete or almost complete binary tree with n ell CaSe ’ the bi "ary search free ,s 
larges, element w„l be OUog in) Z the h^X^V”' of ** 

I, is to note that the total number of binary search t “ ““ be 

elements is found by Catalan number The C T? P ° SSiWe Wi,h n number o{ <“*• 

Utere are four distinct elements then there are ,a u " Uniber is giv “ by -2i- . If 

6.9 Heap h P° ssibl e 

Heap is a very important data structure «,k- u 

m t m memoty h Sfng r a a Une^Zy * SOrt 3 *’ ven 1,St 

following characteristics: Y ’ °’ 3 hea P is a binary t?* 8 i* maintained 

. -pv . ee w h*ch satisfies the 

-*<7^Z‘ZZ b ' ^ * - ah tb c ieaf 

• sat ‘zzx***!—««*+„ nodes sh0lJd * 

to the elements in its child nodS™ node is always at each of its tw0 

ai 8®r than or equal 


242 
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<s min heap in w ^ich the element at each node is less than or equal to the 




hi Id nodes The root node in this mm heap contains the smallest value, 
tree which is shown below: 



A Heap with 12 Nodes (Max Heap) 

T* above binary we is a max heap as i. satisfies both .he properties which are required 

to qualify as max heap. , , , 

. All the levels are completely filled except the las. one, all die nodes m las. level 

appears as far left as possible. 

[ c • , than or eaual to the values at its child nodes. 

• The value at each node is larger tha q element. 

Thus, the root node of the heap contains the largest 

6.9.1 Memory Representation of H«P ^ for mamtaimng 

As already discussed, array representation almost complete binary tree, so 

complete or almost complete binary «s As W ^ below shows seq uent.al 
heap can be stored in linear array e us ing )j ne ar array H. 

representation of the above shown ea —_ I 


40 


30 


40 


50 


10 


20 I 15 I 30 | 20 

10 11 12 


4 * ‘ 7 8 9 

Array ReP resentat ‘^ ^ ^ heap ^ the seqU ential 
aril contains the ro > 0Sltl0n i n the array then its left 

is representation, « no de occupies;ti child will be stored at the 

entation, ifthe element in a ^ s . t . on and its ng 

above shown array child 1 os i t j on (i.e. H[ 3] = 50). 

ieHl11 \S e storeda .(^ 1 + 1) 
id its right child 50 
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The two fundamental operations performed on heap arc Insertion and d H „ 
are described below: 1 ,r 


6.9.2.1 Inserting an Element into a Heap 


Consider an array H which is a heap and we have a data element say flew that 
to insert into the heap. Procedure for inserting the given data element New ls aj ** 

• The data element New will be inserted at the end of array H, go that H 
complete binary tree. 14 K: t 


• After the insertion of element New at the end of heap H, H may not r 
heap. Then this newly inserted element New will rise up to its appr * 
position so that tree again becomes a heap. 


If the newly inserted element New is larger than its parent element then it wi. cxc 
its position with its parent element. This procedure will be repeated again and again -* 
New is less than or equal to its parent element or we reach at the root of the tree 

Consider a heap H of size 10 as shown below. We want to insert an element 92 into 
heap. Procedure for inserting the data element 92 is illustrated below: 
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- we have inserted the new element 92 at the end of the heap such that it is still a 
^t'Tffllete binary tree but after inserting 92, the array H is no longer a heap. So, we will 
92 with its parent element 55. As 55 is smaller than its child 92, we exchange 
^positions as shown below: 
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.. i r. h " DalaSlruct ^ 






r <>5 

[ 72 : 

[ 40 

[35 

<T 

r 44 

A 

[ 05 

9 

[ 45 
10 

1 55 

11 


u .lament r will be compared with its new parent i.e. 85. As its parent 85 is 
slnnelstout. we will exchange the.r poshions as shown below: 



12 

1 85 i 

1 60 1 

1 85 

72 


1 35 

FI 

1 85 1 

1 45 

LsfJ 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

li 


At this stage, we stop the process of comparisons as we 
tree. At this stage, array H is once again a heap. 


Algorithm: To Insert an element 'New' into a Heap ' H ' of size 'n'. 

Step 1: Set n = n + 1 And Pos = n 

Step 2: Repeat Steps 3 and 4 While H[Pos/2] < NewANDPos/2 > 1 

Step 3: Set//[Pos] a H[Pos/2] 

Step 4: Set Pos = Pos/2 

[End Loop] 

Step 5: Set H[Pos) = New 

Step 6: Exit 
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ill * 114 - ^ ea p is increased by one and the variable Pos is set on last position 

tc p l, si# °* thefC i s a loop which repeats its action of step 3 and step 4 while a 
1 * n y In sie P va | ue smaller than or equal to the New which is to be inserted and 
• f nt c \e& cnt W °. er than or equal to one. In step 3, element at Pos/2 (parent 
(Po$ft\ ls * pos ( C hild position) in the array H In step 4, the variable Pos is 
' 'iiioo)» s c0pied a t position). Now, again the new parent element at position H[Pos / 


nt ele me larger than or equal to one. in step 3, element at Pos/2 (parent 

(P 0 S,»» poS ( C hild position) in the array H In step 4, the variable Pos is 

jj!idon) is c0p ‘ ed d t position). Now, again the new parent element at position H[Pos/ 

^ t pos/2 (P are ” /2 dre checked and loop action is repeated again. The control will 

^variable at P» cases when an element at Pos/2 position is found whose 

£ out of lhe l0 °P e i em ent New or Pos/2 is not larger than or equal to 1. In me 

£ IS t St in the heap whtch i. larger than or equal to the 

, rase there is 
later c®** 


rger than or equal to 1 . In the 
larger than or equal to the 

later caSC u,v ‘ 

NeW ' , . New is inserted at the position Pos and array H becomes a heap 

in« 5 : th N| eal ° nnthm is terminat ------ 

m i if —' 


.n ee again m -- 

lexitv of insertion operation in heap is |°f ^ap^incedie tree'h an almost 

Jewrstcase, we need to percoiaje up ^ ^ t0 * wp or root , not 



IVi uiv pcuv LI* - 

a the steps as shown below. 80 

„ _ a, 20 1D 
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Step 2: Insert 7 



Step 3: Insert 10 



Step 5: Insert 20 
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,7: Insert 80 



-> 



-> 



6.9.2J Deleting an Element from Heap 

!n a heap, an element is always deleted from the root of the heap. Consider a heap of 
it elements which is maintained in an array H. The deletion operation on the heap will be 
accomplished as: 

• First of all, we will store the root element of the heap i.e. H[ 1] into 

variable Item. 

* We replace the root element of the heap with the last ^ - s st ^ m 

H[n] and decrease the size of the array by l. At this stage, 

almost complete binary tree but is not necessarily a eap. 

We move the root element of tree down after eomparing and exchangjng^ ^ 
its child elements such that H is finally a hea P' we exchange it with the 
child elements is larger than this root elemen f , 00t ^ smaller or equal to 

lar ger child element. If both the child elements o uire( j. This process is 

root element then it is a heap and no exchang 
re Peated moving downwards in the tree. 
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| 92 | 85 

60 

65 

72 

1 40 1 

1 35 1 

r^i 

1 65 i 

1 45 1 

1 55 

. 2 

3 

4 

5 

6 

7 

8 

9 

10 

11 


A Heap with 11 Nodes 


In the above shown heap, only element 92 can be deleted. For deletion, we will replace 
the root element 92 with the last element of the heap i.e. 55 as shown below: 
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j lit 3“ WP- * e W|U the element 55 with both of its children « . ,, 

,*» «*»<“- »•»■'« -«»«,.«s? 

^lidi.c. elements 55 and 72 will be interchanged. ‘ e arger 



will compare the element 55 with its only child element 45. Now, the child 
^ smaller than its parent 55, which satisfies the characteristic ot max heap, 
we will stop the process here as the binary tree has turned into a heap again. 

To deletes an element from a Heap H' of size n 

Set Pos * i 

St n 

^ 3 : 


Set/tem = H[Pos] 


Set Te 


m P = H[n] And n = n - 1 


s « Left = 2 x Pos And Right = 2 x Pos + 1 
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In the above shown heap, only element 92 can be deleted. For deletion, we will replace 
the root element 92 with the last element of the heap i.e. 55 as shown below: 



1 55 

85 | 

60 

65 | 

72 

1 40 1 

1 35 1 

1 44 1 

1 65 1 

ra 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


we comoare i 1S an _ a m ° St com P lete binary tree but is not a heap. So, in - 

win LT, 5 7 th b0th 0f its children - As 55 is smalto ** 

’ “ m be re P‘ aced wth larger child element which is 85. 


nd stc p, 
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iBfWiWMgw iiti ~ '• ii’ f ~'i’• ^irrTfritffin ^8% ffiNjsBTrtl^ 


i 


2 


4 


6 


7 


3 6 7 8 9 10 

. * sec *t comp - ' *•*'* element 55 *ith both of its children 65 and 72. As 55 

' jr i*s x«h o: its children so, 55 *ill interchange its position with the larger 

. t&srtSi 55 and '2 -a ill ce interchanged 



%5 I 72 I 60 1 65 1 S5 | 40 | 33 | 44 1 65 1 45^ 

j 2 ^ 3 4 5 6 7 8 9 10 

^ ** '«il cospare the element 55 *itn its w f 1 ^ V^^emtic of max heap. 
*««5 a mate than Kt parent 55. ^.^‘^^mtoaheapagam. 

-e will stop the process nere as the ci.i^ry ~e. a 

To deletes an element from a Heap H °f , * ze n 

**Pos = l 

= H [Pos] 

x* Temp = H r n] Andn = n - 1 


Wi- 

v <52 

W- 


y< ?4 


1 c "ip = n n aug n - •* 

^•Wt = 2 / Pos Azd Rlgto = 2 * pw * 
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- - E - - 6 ,Q g While RlgM £ n 

SKP * Temp 2 H[Left] AND Temp 2 H[Rlgkt] 

Set H[Pos] = Temp 


Step 6: 


Step 7: 


Step 8: 


Step 9: 


[End If] 

If H{Left] 2 //[*<«W] Then 

Set *[fwj = «!*•/»] And PoS = te/t 

Else 

Set W[Pos] - And Pos = Rlght 

[End If] 

Set Left = 2 x Pos And Right - 2 x Pos -I- 1 
[End While] 

Ifle/t = nAND Temp < H[Left\ Then 
Set //[Pos] = H[Left] And Pos = Left 


[End If] 

Step 10: Set H[Pos] = Temp And Return Item 

Note: The 9 th step in this algorithm will be executed in the cases when the variable 
Left reaches n. The execution of this 9 th step can be observed in the deletion of an 
element from the heap shown below: 
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v$ deleted from the root ol the heap. Heap is stored in array where 
■ , ient al " d> root of the heap. In step l, variable Pos is set on the first index 

V f. boldi 1 ^ ** the value stored at first index position. In the second step, value at 
for del etin ^ g co pted into the vanable Item. In step 3, last element of the heap 
P° siti ° n ton n (heap is having n elements) is copied into a variable Temp 

^Vnfreduced by one. 
tiF* . n f heap |S rc 

^ a oosition one i.e. H[ 1] is lying vacant, the left and right children of 
0 s^'.'memare store d at 2 x Pos (2 x 1 = 2) and 2 x Pos + 1(2 x X + 1 = 3) 

respectively. 

udarP” . whlcb repeats it actions of step 6 to 8 while the value of vanable 

■ s tep 5, ‘ s 3 ° g 0Ua i to n In step 6, value stored in variable Temp is compared 

tight is leiS oositions Left and Right. If the value in Temp is greater than 

.^elements at in £ ^ index positjons Left and Rlght bo th then the value 

arequal to Tgmp u copied in the heap array H at index position Pos (from 

'tat element was deleted! 

, .a* .he case when the value stored in the vanable Temp is not greater than 
Step ’deals withi the c ^ posjtions Left and Right both. In this case, value 

„ equal to the v in(Jex pos ition Pos rather it is checked that which 

„remp cannot be “P . . If H[Left] is larger than or equal to the 

tiement H[Left] or H[ g] u\Right] then element at index position Left is 
element at index position Right . ■ I 9 , i.e ft On the other hand, if 

the value at index position Right i.e. H[n g J Rtnht is copied at index 

pos- Left i.e. H[Left] then element at index movement 

position Pos and Pos is assigned the value Right In this s ep 
takes place depending upon any of the child element ts larger than current paren 

Instep 8, new Left and Right are calculated corresponding to current val 

J 1 * step 9 is executed only in the case when the variable p |^"into the heap array H 
heap), in step 10, the value kept in the variable T p , ,, bodl are either 

'“"tong the correct position Pos, wh.ch the left and nght chtldren bom 

SI? °r equal to their parent element. 

leM«. Plexity of deletion operation from heap is 0( %”^ od e takesftie constant 
^ 6°« the root of the heap therefore, the deletion of ttenode ta ^ , n ^ 

’ aber deletion of the root node, we have to heieht of the heap with » 

iesi, *' We *111 move down to the bottom/leaf. Since . ume is 0(lo9'. n ' 

,S °( lo 8in) where n is the number of nodes, the worst runntng 
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6.9.3 Heap Sort 

■ .hr preceding subsections, heap tree and operations performed on it a, e , 

Heap provtdes an effic.ent way to sort any given list of elements. The strate *>! 
“Xg I unsorted list using heapsort technique is: R » 

First of all the given unsorted list is converted into a max heap then, because of then 
oroDertv of the max heap that root node always contains the largest element of th e ? r 
the heapsort extracts elements from the heap one at a time by deleting the root of J 
heap, which is always the largest element in the heap and restructures the heap again with 
the 2 nd largest element at the root. The process continues until no more elements are let* 
in the heap. The deleted elements are placed at the appropnate place in the array, which 
will be sorted at the end of heap sort. The process of sorting using heap sort is illustrated 


Consider the unsorted array A of size 8 shown below: 


A[l] 

A[21 

A13] 

A[4] 

A[5] 

A[6] 

A[7] 

A[8] 

L“J 

35 | 

17 

8 J 

13 J 

44 

5 

28 


First of all, array A will be converted into a max heap as shown below: 
© 
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l- _ _Heap —-- “ 

. ^ 4 . j r-« I ( 44 here) and place it at the last position in 

,* ** P0S1, ' 0nS Aft " COmP ' e “ 0n 
**> A will be as shown below: 


r- List 

: „ * second step. AW ’ h ' 

. a 

2 3 4 



n Heap -*2? 

<• e u m ents will be 

" 1“ 3- step, j 4[3] (”28) will Tie P ^“° n °' ^ 
«d in first five positions. The de 

® shown below: “ fi 

S 4 





rtIna ®ing 4 steps are shown 


Heap 

below using th«s ame 
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Step 4: 


Step 5: 


Step 6: 


1 

2 

3 

4 

5 6 

7 

8 

1 17 

1 13 J 

Ljj 

Li 

22 28 

1 35 

i 





1 Sorted 

List 


1 

2 

3 

4 

5 6 

7 

8 

1 13 1 

1 5 

1 8 1 

[TT| 

22 | 28 

35 | 

L«j 


Heap 


u 


—+j 

H 

-►] 





i 

2 

3 

4 

5 6 

7 

8 

LlJ 

LeJ 

nn 

jD 

22 | 28 

£fj 

jlJ 


|+- Heap— 


■Sorted List* 


-H 


Step 7: 


i 

2 

3 

4 

5 

6 

7 

8 

5 

8 

1 13 

E 

| 22 

28 

35 

44 


K 


■Sorted List- 


*1 


Algorithm: To sort an array'//' of size 'ri using the Heap sort technique. 

HeapSort (H, n ) 

The first four steps of the algorithm will convert the unsorted amy A into a heap 
s eps. through 8 will sort the array by repeatedly deleting the root of the heap. 

Repeat Steps 2 to 4 For / = l to n - 1 
Set Pos = J + i And Temp _ 

Repeat While H[Pos/2] < Temp AND Pos,2 > 1 
Set H[Pos] = H[Pos/2] 

Set Pos = Pos/2 
[End Loop] 

Set H[Po 5 ] = Temp 

[End Loop] 

Repeal Steps 6 and 7 Fork = n to 2 


Step 1 
Step 2 
Step 3 


Step 4: 
Step 5 
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a loop having n 1 iterations, one less tiv„„ t h r M;r tlj 


the arra\ to be 


, (here is •> loop nnvm* 

'"Z in *>* 2* s,ep • ,m " Hlly ° n ® Clemem " h,ch “ •* IHWituw will ’hT^'w , 
W« fsiw ° ne 

a a single element is a heap in itself, step } is a loop which repeats ns acturns of u „h „ 
the correct position Pos for the 2* element. Once the correct position. when: the paiem 
is greater than or equal to the child elements is touiul, the step 4 copies the values j 

position. 


In the same manner first four steps of the algorithm adds 3"\ 4*, 5 ,h . n* elements 
the heap one by one. After the n — 1 iterations in step 1, the whole unsorted a:ta\ gets 

transformed into a heap of size n 


In step 5, there is a loop which repeats step b and step ? for the value of \anable k 
n to 2 in a decreasing order with step size one. In step b. sub-module Deleteltem is 
called by passing the values, array H and k The value of k depends upon the iteration 
Initially, k = fl and this value decreases as the loop iterates which returns the largest 
value of the heap. This value is returned in a variable Item. 1 he step copic> that ^ c 
at index position k. __————————— 


Analysis of Heap Sort 

Heap sort has very good running time performance on random 1> ordered elements ofth 
h does not require massive recursion or multiple arrays tor its \w_ 
^performance is effectively the same as the average case. ^ 

^ worst case running time to sort n elements is 0(n login)* 
complexity of deletion of a node from the heap is 0(log 2 n) and m heap son, «d ^ 

I' 1 Aments. Therefore, the complexity of heap non- 

which in turn comes out to be 0(n log 2 n). 

1Ve a ^8orithm which makes it a good choice tor extreme > 
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1 . 


Explain the following terms: 

a. Edge 

b. Internal and External nodes 

c. Height of tree 

d. Degree of a node 

e. Path 

f. Depth of a node 

g. Weight of a tree 

h. What is binary tree? Write down the properties of a binary tree. 

i. Explain the followings: 

j. Similar binary trees 

k. Equivalent binary trees 

l. Complete binary tree 

2. What is the difference between binary tree and binary search tree? Write down the 
algorithm to delete a node from binary search tree. 

3. Explain the linked as well sequential representation of binary tree. 

4. Explain the traversing techniques of binary tree. 

5. Write down the order in which the following binary trees will be traversed. 




a. In-order 

b. Pre-order 

c. Post-order 
d- Level-order 

6 ' EXPlai " Wh0le tenni ”oK>gy on the following binary tree. 
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' trees. 


, Explain the limitations of sequential representation of binary 
What is the number of nodes at i th level of 

5 - 

a a complete binary tree with height k, i < k 

b. an almost complete binary tree with height k, i < k 

y Represent the following expressions into binary tree and then traverse the tree in (a) 
pre-order (h) in-order (c) post-order 


(c) post-order 
i ((« + b)/c) x (d — e) 

b. ((* — y ) + z)/(w— V) + t 

c. (a + b/c x d)/(e A f/g ) 

d. ((a - b) x (c — d))/{e + /) 

10. Draw the binary tree whose in-order and pre-order traversals 
In-order: g d b 
Pre-order: a 


are: 


e 

e 


i 

h 


a 


f 

c 


11 . 


; are: 

J * 

b a 


c 

*«v-uiuw. a b d g e h 1 c f 

Draw the binary tree whose in-order and post-order traversals 
h-order: dckeahbq 

Post-order: d k e c h q J * 

12 

^bte a note on threaded binary trees. h 

IJ ' down the procedure to find the smallest and largest element in a « 5 

H ^ a binary search tree by inserting the following numbers in sequent 

! °’ 39 ' 70 > 90,45,15,40,46,35, 100,65,60 
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a. Add an element 10 into T 

b. Add an element 44 into T 

c. Delete the element 35 from T 

d. Delete the element 40 from T 

e. Delete the element 45 from T 

16. What is heap? How it is different from a binary tree? Explain heap sort algorithm. 

17. Explain the heap sort algorithm with the help of an example. 

18. Draw the max heap and min heap with the following elements: 

70 80 50 45 95 25 30 100 90 85 15 10 

Vk rite down the procedure to delete an element from heap using an example. 

20. Explain the memory representation of Heap. 


(Questions fro m various Universities previous Examination,) 

1 Write the algorithm to count number of leaves ofa binary tree. 

1 Write * he algon,hm 10 fi "<i *e height ofa binary tree. 

Explain Heap sort algonthm with an example of 5 elements. 

theTame b se^en« e of values mentS “ Whi ° h In '° rder and Po3, -° rder ' 

elements? For a heanhh^ max ' raum depth of a binary search tree stonn> m ut 
end minimum depth?* 8 Same nUmber °f elements, what is the ^ 


3. 

4. 


nelds 
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t>T« of binary tr«s «», can ^ 

'jfi *" ] 12 2 ^ om ^ le following 


search tree. 


I 

19 . 


26 . 


22 . 

23 . 

U. 

2}. 


J * ' 

_ iffW the touching elements will be inserted in a binary 

&x fiT.R- E 

v'*- . . „ . 


»*, . « “ aimum “ d m “ ,mum ** of • »>™> rearch lr« storing ,J 7 

,.V algorithm to delete an element from a binary search tree 

- . . 

_ tljc different tree traversal techniques. 
dO* 11 

>tn d* kt ' s “ tht alTa> below ' whal m !' resuhs &om creating the initial heap? 

( 'cHCf° £fi 

'■-tile a binary search tree with the values 1 3 5 9 2 4 6 8 and show in which order, 

C nodes of the tree will be visited for i) Pre-order ii) In-order and iii) Post-order 

jrivertsls 

js the minimum and maximum depth of a binary search tree storing 100 

For a beap storing the same number of elements what is the maximum 

dements, rw r 

jjij minimum deptn 

jnajjmum and maximum number of levels that a binary search tree with 100 
ysSa can have, are _and_respectively. 

Draw a tree of 3 elements that satisfies both the binary search property and the order 

property of heaps. 

Define (i) almost complete binary tree (ii) strictly binary tree 
Acomptett binarv- tree contains 15 nodes. Calculate the depth of the tree. 

What are the limitations of binary trees 

Whit is binary search tree? How is it represented in memory? Show the insertion o 
the following elements in a binary search tree. 

3,12,18,48*25,1 3,24,29, ^ de r traversal of threaded 

What is threaded binary tree? Write an algon 

btnary tree without using the stack. ^ ^ a bbary ** 

*me a program to count the number of leaf an 

Explain Binary tree Vs Binary search tree. nted in me mory? 

is complete binary tree? How are binary trees r 
w rite algorithm for pre-order traversal of a binary tree. ^ 

WrSte and explain in-order traversal algorithm of binary 
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c; T »f,ed Approach to Data Structures- 

26^ Write and explain post-order traversal algonthm of binary tree. X 

27. Write an algonthm to find the depth of a binary tree. 

28 Explain the searching operation on a binary search tree. 

29. Sort the following data elements using the heap sort algorithm. 

29, 30, 2, 1, 199, 80, 10, 19, 0, 100 

30. Explain the heap sort algorithm with example. 

31 Explain the complexity of heap sort. What is the difference between binary tree a>v 
binary search tree? Write down the algorithm to delete a node from binary scarc ; 

tree? 

32. Explain the algorithm for post-order traversal algorithm of a binary tree. Also 
execute the algorithm with an example. 


(Multiple Choice Questions) 

1. Which of the following cannot generate the full binary tree? 

A. In-order and Pre-order 

B. In-order and Post-order 

C. Pre-order and Post-order 

D. None of the above 

2. To represent hierarchical relationship between elements, which data structure 

suitable? 

A. Deque 

B. Priority Queue 

C. Tree 

D. All of above 

3. A binary tree whose every node has either zero or two children is called 

A. Complete binary tree 

B. Binary search tree 

C. Extended binary tree 

D. None of above 

4. The depth of a complete binary tree is given by 

A. Dn = n log 2 n 

B. Dn = n log 2 n + 1 

C. Dn = log 2 n 

D. Dn = log 2 (n + 1) - 1 

5. A binary tree can easily be converted into a 2-tree 

A. by replacing each empty sub tree by a new internal node 
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Tree 






v* 

0 


- ron g a> mlrmal nodts lor “on-empty node 
»' 'Lmni » external nodes for non-emptY node 
W ^UOflg each empty sub tree by a new external node 

btnarv tree into extended bin&rv tree aii • • 
coo'’ 8 ® 1 ® “taey tree, all the original nodes in binary 


* 

8 * * ^ a0 dcs on extended tree 
A nodes on extended tree 


node, on exienuc. 
,„ lC hod on extended tree 


.crushed on < 

Sons ofabove 

, bony tree. certain null entries are replaced by special pointers which point to 
' , v.^er in the tree tor efficiency. These special pointers are called 

a I «al 


branch 


nodes 

.v L * 1 

B 

C . 

D thread 
t , gcap tree 

' \ Values in a node is greater than every value in left sub tree and smaller than 

right sub tree 

B Values in a node is greater than every value in children of it 
C. Both of above conditions applies 
D None of above conditions applies 

} Maximum number of nodes in a binary tree of height h 

A. 2 k+1 -l 

B. 2 W +1 

C. 2*+l 

D. None of these 

Binary Search Tree is a , t 

A. tree whose right and left sub-tree has value ess 

tree whose nght and left sub-tree has % a ue m ° r ® sub-tree has value 

tree whose left sub-tree has value less than roo 

more than root, 
none of the above. 


D - *** of tbc above. a n 7 \hc number of 

Up , .r \ M f nodes and ti& tn 

1 - ^or a non-empty tree T, if nO is the number 


B 

C. 



A. 

B. 

C. 

D. 


nO = 


2 then 
n2 + 1. 
n0 * 2n2 + 1. 
J? * 2n2 + 1. 

^ ooe of these 


• '(it 


‘ ^°ne of these _ enlSi the tree IS to *° WD 

^ ^rder traversal of tree will yield a sorted listing of 
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Tree 


p- 


an internal nodes for non-empty node 
8 * loserting an external nodes for non-empiy node 
% by replacing each empty sub tree by a new external node 

^verting binary tree into extended binary tree, all the original nod • _ 

ungmal nodes in binary 

c on extended trep 




v* ^ erna l nodes on extended tree 
A ‘ external nodes on extended tree 
?' vanished on extended tree 

p None of above 

tree, certain null entries are replaced bv snpriai * 

the tree for efficiency. These snecial nLw! “ ?!? whlch P° int t0 


In a binary' “““ aic ‘cpiacea by special pointers v 

nodes higher in the tree for efficiency. These special pointers are called 

A. U* f 


3 branch 

C. path 

D. thread 


g. In a Heap tree 

A. Values in a node is greater than every value in left sub tree and smaller than 

right sub tree 

B. Values in a node is greater than every value in children of it 

C. Both of above conditions applies 

D. None of above conditions applies 

9. Maximum number of nodes in a binary tree of height h 

A. 2'* +1 -l 

B. 2 h+1 +l 

C. 241 

D. None of these 


10. Binary Search Tree is a 

A- tree whose right and left sub-tree has value less than root. 

D a _ • . . . . ~ , t_i..« than rnn 


ft- tree whose right and lert sub-tree nas vaiuc man * w* 

B- tree whose right and left sub-tree has value more than root. 

C. tree whose left sub-tree has value less than root and right su * ree 


more than root. 


D - none of the above. f 

" Fot a non-empty tree T, if nO is the number of leaf nodes and nt the number o 
•“ties of degree 2 then 
£ n0 « «2 + 1 . 

C n0 = 2n2 + 1 . 

D. n “ 2n2 + 1- 

one of these . ae€ j$ known 

^ “‘•order traversal of tree will yield a sorted listing of elements. 


■ 


A 
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.. to Dai* Structures. 


A. Binary tree 

B. Binary search tree 

C. Heap 

n None of above 


13. Maximum height of a binary search tree with n number of nodes is 

A. n - 1 

B. n 

C. n + 1 

D. None of above 

14. Insertion in BST always takes place as 

A. leaf node 

B. non leaf node 

C. root node 

D. None of above 


15. In a BST, deleting a node with two children involves replacing the node to be deleted 
with 

A. pre-order successor 

B. post-order successor 

C. in-order successor 

D. None of above 


16. In a BST, largest element is present at, 

A. extreme left node of the BST 

B. extreme right node of the BST 

C. Root node 

D. None of above 

17. Which of the following data structure is not linear data structure? 

A. Arrays 

B. Linked lists 

C. Both of above 

D. None of above 

18. The height of a complete binary tree with n elements is given by 

A. Dn = nlog 2 n 

B. Dn = n log 2 n + 1 

C. Dn = log 2 n - l 

D. Dn ss log 2 n + 1 

A 1 " C^UtTb^ n0<le haS eithCT “ TO ° r tW0 children 1S called 

B- Binary search tree 
c Strictly binary tree 
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Tree 



ofabove 

fomentation ot bmar\ tree, the right child of root will be at index 

I : 

C 3 

D A 

present hierarchical relationship between elements, which data structure is 

suitable ^ 

A. Deque 

B Priority 

C. Tree 

D Ml of above 

a Number of nodes in a complete binary tree with eight levels is 

"a. 127 

B. 128 
C 255 

D. 256 

23. Root node has 
A Zero 

B. Two 

C. One 

D. Three 


.no of predecessors? 


C. One 

D. Three , by special pointers which point to 

In a binary tree, certatn null ^hese special pointers am called 

nodes higher in the tree for efficiency 

A. Leaf 


24. In 

A. Leaf 

B. branch 

D. thread s jbou , binary trees is NOT true 

25. Which of the followmg °<* a ^ T00l node. 

A. Every brnary tree has exactly ° 

B. Every non^P* m0St parent- 

C. Every node has has exactly 

D Every non-roo ^uired t0 _^ a1l 


C. Every node has *£* e *actly „ a value in a binary 

D. Every non-roo ^uir^^sonable assumptions about e 

26. What is the ex jJ eC !wYou she 11111 * 

containing n nodes 


search tree 
structure of 


What is the exp ^y oU : 
containing n nodeS 
the tree.) 

A. 0(1) 

b. o(iog n > 

C. 0(n) 

D. o[nlog n) 
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l nul lify approach to Data Structure^ 

E 0(n 2 ) 


27 4. Priority-Queue is implemented as a Max-Heap. Initially, it has 5 eleme 
level-order traversal of the heap is given below: 


nts Th c 


10,8,5,3,2 ,. , , . , 

Two new elements ”1 ‘ and ”7‘ are inserted in the heap in that order. The level 
traversal of the heap after the insertion of the elements is: ' 0r <kr 


A. 10, 8, 7, 5, 3, 2, 1 

B. 10,8,7,2,3,1,5 

C. 10,8,7,1,2,3,5 

D. 10,8,7,3,2,1,5 


28. Which of the following traversals is sufficient to construct BST from given traversals 
Inorder, Preorder, or Postorder 

A. Any one of the given three traversals is sufficient 

B. Either 2 or 3 is sufficient 

C. 2 and 3 

D. I and 3 


29. How many distinct binary search trees can be created out of 4 distinct keys 9 

A. 4 

B. 14 

C. 24 

D. 42 


30. The preorder traversal sequence of a binary search tree is 30, 20, 10, 15, 25,23,39 
35, 42. Which one of the following is the postorder traversal sequence of the same 

A. 10,20,15,23,25,35,42,39,30 

B. 15,10,25,23,20,42,35,39,30 

C. 15,20,10,23,25,42,35,39,30 

D. 15,10,23,25,20,35,42,39,30 


3L STet^ mberS 7 ’ V’ 8 ’ 3 ’ 6 ’ °’ 9 ’ 4 > 2 are inserted in that order into an 
natural numh^rc ^ • treC ‘ The ^ inary searc h tree uses the usual ordering c. 

A. 7510324689 1Stie m ’° r<ier sequence of the resultant tree 0 

B. 0243165987 

C. 0 1 23456789 
D - 9864230 1 57 


u b e a f c * “ d a 

B. edbgfca 

C. cdbfgca 
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r ««M of a binary “7 “ *e maximum number of«,w 

1* ^,mum number of nodes m a binary tree of he, gh , h " ny r '»> to leaf path 


A 2 

A ,»-J - 1 

5 lh+1 - 1 
^ 2 * (A + ^ 


or 3 


„ ^ number of leaf nodes in a rooted tree of n nodes, with each „„ de h.v,„ g 0 
-bilctren is. 

4 n/2 

B (n-D/3 

C. (n - 0/ 2 

D. (2 n * 

s Consider the following nested representation of binary trees: (X Y Z) indicates Y and 
'' Z are the left and nght sub stress, respectively, of node X. Note that Y and Z may be 
SULL. or further nested. Which of the following represents a valid binary tree? 

A. (1 2(45 6 7)) 

B. (1(2 3 4) 5 6) 7) 

C (1(23 4X5 6 7)) 

D. (1 (2 3 NULL) (4 5)) 

* Let LASTPOST, LASTIN and LASTPRE denote the last vertex visited in a 
postorder, inorder and preorder traversal. Respectively, of a complete: binary tree. 
Which of the following is always true? (G ATE 2 

A LASTIN = LASTPOST 

B. LASTIN = LASTPRE 

C. LASTPRE = LASTPOST 

D. None of the above 

following numbers are inserted into an empty binary sear^ e height 
order: 10,1, 3, 5, 15. 12, 16. What is the height of the bmary ^ ^ ^ 

Is the maximum distance of a leaf node from the roo 

A. 2 

B. 3 
c - 4 

^ ^Wder traversal nf « .riven binary search tree, T 8 40. 

’ be me result of-V, 


If* 


traversal of a given binary 
^ ch °ne of the following sequences of keys can 

of the tree T? 

B ’• JO. 15,22,23,25,27,29,40,50,60,95 
’ l0 > 15,22,40, 50,60,95,23, 25, 27, ^ 
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5 


u. ^ # 


39 A scheme for storing binary trees in an array X is as follows. Indexing of x sf 
‘ instead of 0. the root is stored at X[l]. For a node stored at X[i], the left chil ?*«l 
is stored in X[2i] and the right child, if any, in X[2i+1]. To be able to st ir y ’ 
binary tree on n vertices the minimum size of X should be. (GATE CS 2006) e ^ 

A. log 2 n 

B. n 

C. 2n +1 

D. 2 n — 1 


40. Consider the following C program segment 
structCellNode 
{ 

structCellNode *leftchild; 
int element; 

structCellNode *rightChild; 

} 


intDosomethingf structCellNode *ptr) 

{ 

int value = 0 ; 
if (ptr != NULL) 

{ 

if (ptr->leftChild != NULL) 

value = 1 + DoSomething(ptr->leftChild); 
if (ptr->rightChild != NULL) 

va * ue = max (value, 1 + DoSomething(ptr->rightChild)); 
return (value); 

} 

emntv a !rw. r ^ tUnie ^J 3 ^ ^ mct * on DoSomething when a pointer to the root 

a^i 5 , paSSed 38 is (GATE CS 2004) 

A. The number of leaf nodes in the tree 

B. The number of nodes in the tree 

D ^“fiotemaUcdesinthetrce 

u - The height of the tree 

values of to chikten P wh"i! * evalue of each parent is greater than or *4“** 10 
children. Wh,ch of the following is a max-help? (GATE CS 20111) 


of anon- 


& 



Scanned by CamScanner 








42 . The elements 32, 15, 20, 30, 12, 25, 16 are inserted one by one in the given order into 
a Max Heap. The resultant Max Heap is 



A 

* B 

9' c 
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^ Simpl ified Approach to Data Structures 

43 In a binary max heap containing n numbers, the smallest element 

time (GATE CS 2006) can fouw 

A. 0 (n) * 

B. O(logn) 

C. 0 ( loglogn ) 

D. 0(1) 


44. We have a binary heap on n elements and wish to insert n more el 

necessarily one after another) into this heap. The total time required for th ,ment8 ^ ot 

A. O(logn) 5IS 

B. 0(n) 

C. 0(nlogn ) 

D. 0(n 2 ) 


45. In a heap with n elements with the smallest element at the root, the 7th smalls 
element can be found in time 

A. Oinlogn ) 

B. 0 (n) 

C. 0 ( log n ) 

D. 0(1) 

46. Consider a binary max-heap implemented using an array. Which one of the following 
array represents a binary max-heap? (GATE CS 2009) 

A. 25,12,16,13,10,8,14 

B. 25,12,16,13,10,8,14 

C. 25,14,16,13,10,8,12 

D. 25,14,12,13,10,8,16 


47. What is the content of the 
the previous question? 

A. 14,13,12,10,8 

B. 14,12,13,8,10 

C. 14,13,8,12,10 

D. 14,13,12,8,10 


array after two delete operations on the correct answer to 
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^apter 7. Advanced Tree Structures 

(AVL Tree and RB Tree) 


, 1 introduction 

us chapter, we have discussed the basic tree structures like binary tree, 

U the heap etc. In this chapter, we will discuss some advanced tree structures 

"iuaiy scarc j ^vL Tree, 2-3 Tree, 2-3-4 Tree, B-tree etc. These advanced tree 

as b»unced trees. 

. f c thc term balanced tree, it is necessary to recall the term height of the 
Before we acI , lhe tree as already defined, is the maximum number of levels in the 
ulh of the longest path from the root node. The height of an empty tree 
* 23S of the we having only one node is 0 and so on. A balanced tree Is a 

4 ' Vbtehfhe difference of heights of left subtree and right subtree of any node Is 

train which th should not be more than one. A balanced tree 

£ ££1^- insertion^operation. Le, us dtscuss these advanced bee 

structures in detail in following sections. 

1.2 Red-Black Tree 

Aral-black tree is a binary search tree in which long°as any other 

red-black tree is a balanced tree because no pa 
pah- Each node of the red-black tree c ontains five iiem 

CoIot^L eft" va i ues a;e used 

wlor field Of this node is taken as one bit held as only Two p^ of the parent 

2* * Black) for this field. Parent field of the node conta 
xl 'ofthe current node. 

ll *k tree must satisfy the following properties: 

Every node of the tree is either red or black. 

Th * root node of the tree is always black. ^ ^ be black- 

a node in the tree is red then it’s both the child 
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. -*• *" nata Structures^ - 

A Sitnpli __ —ti— " "T its descendent leaf nodes coniain the 

AUt hepa*sfr» ffian0det ° 

of black nodes. 

. All the leaf nodes must be black. 

f the actual leaf nodes but are taken as dummy nodes which 
Here, the leaf nodes are not to ^ of both fields of the node. These (him^ 

in actual Null pblack nodes. The following tree (shown in figure ^ 
nodes are shownby smalle ^ the five c haractenstics of the red-black tree; 



In the above tree, we assume the blank node as the red node and the tilled shadeu nod* 
the black node. 


• Every node is either red or black. 


• The root node (key = 50) is black. 

• Every red node (here, node with key = 35 and key = 80) has its child 
which are black in color. 

• All the descendent paths from any node contain same number ot black^ 
e.g. all the paths from root node contain exactly three black nodes u u 
dummy black leaf nodes). 

• All the leaf nodes (shown by small oval) are black. 

Some important facts about Red-Black Tree 

black tree with n nodes has the maximum height of almost ^ 

as black hei^t ofAe^ee 8 ° D ^ & ° m r ° 0t node t0 ^ ^ 

m ° re than l wlce as lon 8 as any other path in the tree. 
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Advanced Tree Structures 


0,1 Red - Bi “ k Tr “ 

01 J l/P c j, ua structures, following are the three main operations that can 

-lar W otb %dSack tree: 

Searching 

\ insertion 

| peteno" 

ilj.l S** rchin ® , finHing the address of a node containing desired 

' h ooeration is defined as fin® 8 tree js fonned similar to the search 
ft* iearC The P se arch operation on r h red-black tree is the binary search 

binary This in BST is 0(h) where the 


’ The searen use - the red-blacK tree » me «...«• j ™ 

nicnt ' ? Kinarv search tree. This is beta , . q(/i) wherc t he h is the 

eration for b,n ^ com nlexity of search operatic n operation is 

-—- 

2.1.2 Insertion ilM manner as that of binary 

emoii operation in red-black tree isP^l utlo „ of 

»ch tree with possibility that may result ^ ^ the properties 

cause new node need to be inse nec( j t0 

ick tree after inserting new node, 

• Change the color of some nodes 

• Rotate the tree in left or in right dii to o(lo02 n ) bccausC 

.r»« s- jar: - - *■* 

c >s balanced. Before discussing the insci u 

0ut two rotations: 

!ftR0,MlOn uru t. onofW o nodes on the ngh> 

, ^ r °tation is performed by transforming the following hg 11 
^figuration on the left side as described « 
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Left Rotation 



Before Left Rotation After Left rotation 

Here, a, (3, y are the subtrees. 

From programming point of view, the rotation means change of pointers as explained 
following algorithm: 


Algorithm for Left Rotation (Left Rotation is performed on node V in tree T). 
LeftRotate ( T,x ) 

Step 1: If x -> Right * Null Then 

//Attachy’s left subtree as x’s right subtree 
Step 2: x -* Right = y -> Left 

//Ijy has a left child then make x as its parent. 

Step 3: lfy-+Left * Null Then 


Step 4: 


Step 5: 


Step 6: 


y Left Parent = x 

[End If] 


y - Parent = * -> Parent //Make x 's Parent asy's A"*"' 

7/ >f * “ ' he le/l chHd °f to Parent then make y as its left child. 

If Parent-.Left = * T hen 
x -* Parent -* Left = y 

* “ >he nght chUd °f‘ ts Parent then make y as its right child 

*"«*-'*" ent-. Rlght = xThen 

rPnH rn * Parent Right = y 


y-Left = * 


//Makex asy's left child 
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Els® 

print: “Left Rotation is not possible” 



Right Rotation 

The Right Rotation is performed by transforming the configuration of two nodes on the 
left into the configuration on the right side as described in the following figure. 



More Right Rotation 

re the subtrees. 


After Right Rotation 


! the subtrees. of poin ters 

“hng point of view, the right rotation means 

towing algorithm: 


OUcUIMUU uyOcii I lOUdi n it?i 





RightRotate (T,x) 

Step 1: If x ^ Left * Null Then , 

//Attach y’s Right subtree as x’s Left subtree 

Step 2: * - Left « y -♦ MqK 

f/lf y has a right child then make x as its Parent. 

Step 3: If y-* Right * Null Then 

y -» Right -» Parent = x 

[End If] 

Step 4; y -» Parent = X -> Parent //Make x’s Parent asy’s Parent 

H Ifx is the left child of its Parent then make y as its left child. 

Step 5: If x -* Parent -* Left - x Then 


x -* Parent -» Left = y 

// lfx is the right child of its parent then make y as its right child 

Else If x -» Parent -> Right = x Then 
x -» Parent -> Right = y 
[End If] 


Step 6: y -» Right = x 

Step 7: x -» Parent = y 


//Make xasy’s right child 
//Makey as x’s Parent 


Else 


Print: “Right Rotation is not possible 


[End If] 

Step 8: Exit 

For example, applying the right rotation on the 


the node having (key * 60) in the f°"° 


BST. 


60 


30 
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.,, , vanced Tr ee Structu res 

_ „ nn a e m a red-black tree can h<» 

becaUM red ' b i aCk tr f C is also a binary learch'tree comp ' exi, 5' of 

' loS> n - L node is done similar to the way as in binary search ?T g first S “P. 
> o0 „ ^d red. in second step, i, is verified and mSemd 

& *■ ' are preserved after insertion. If it is not, the nodes of the nee are ^ 
voP etneS nerformed as required. ee are ™-colored and 

•>os & p 

' ’ „,W node to be inserted is x (obviously the node * is currently redi If .hi. * , 
node shows the red-red conflict i.e. the node at and its parent node both meT d 
^requires some modification in the tree so that the resulting tree presets the red- 
properties. To restore the red-black tree properties, there are four cases as 
fl8C below. We take a, P, Y» 8, c as the virtual leaf nodes which are black. Here, the 
^4 node j g represented by the empty circle and the black node is represented by the 

shaded circle. 

j. jf parent of node x is the left child and uncle of node x is red then 
’ ^jqj- flip. That is, the grand parent of x becomes red and both the parent and 
u l of X becomes black. Here, the grandparent (which is now colored red) may create 
sd-red conflict with its parent. If so, the grandparent node is taken as x and all these four 

cases are discussed again. 
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For example: 




flip is performed. That * 1S ^ nght Child and uncie °f node x is red ^ 
become black. Here the 6 gTandparent bec °mes red and both the parent and unt« 
conflict with its parent Tf parent ( wb i cb is now colored red) may create - re 
are discussed again. °’ 6 grandparent node is taken as x and all these lour 
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Insertion of 170 


RB Tree as there is no red-red conflict now 


c.« 3: If parent of node x is left child and unde of node x Is black then two * 

cases arise: . 

If , i, the right child of its parent then perform the left rotation. After ta 
* mutton *e node x and its parent are interchanged and we take the new child as 

x which is now the left child. 

. If X is the left child of its parent then change die color of parent of node. 
and arandparent of node x and perform right rotation. 
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A Simplified Approach to Data Structu res 

Let ui create the red-black tree using the following elements: 


150, 140, 130, 120, 125, 122, 110, 100, 105, 102 


Insert 150 



Insert 140 



Insert 130(Case 3) 



Insert 120(Case 1) 
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•'<£9*1 t'g** , . .V;-^. ..u.V.T'l: ' ■'• ?P 



A Simplified Approach to Data Structures 


Insert 100(Case 1 and 3) 



Insert 105(Case 3) 
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Advanced Tree Structures 



. Re d-Bla<* trec 

Algorithm: Insert » node BSTInS ertlonO algorithm and 

RBTreelnsertlon (T, *) < ^ e( j-Bl ack tree UM 

Step i: insert the n ° de * V w = Red) 

color the node * nt ^ Co parent _> Le ft) Then 

S.P 2: Repeat While (* “ „ , - night -* Color - Red! Then 

Step 3: If (*-* Pa pa rent- P 

Step 4: If( * 


285 

A 
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■ sim plified Approach to Data Structures- 

//Case 1 when x's parent is left child and 

W red 

x -> Parent -+ Color = Black 
x -> Parent -* Parent -> Right -4 Color - B , 

" o(q c l 

x -4 Parent -* Parent -> Color = #ed 
* = x -+ Parent -» Parent 


Step 6: 


Else 

// Owe 5 wtew x’s w left child and x’s uncle is black 

If (x = x -» Parent -» Right ) Then 
//j/x w Right Child 

x = x -4 Parent 
LeftRotate (T,x) 

[End If] 

// If x is Left Chid 

x -» Parent -> Color = Black 
x -4 Parent -♦ Parent -4 Color = Red 

RightRotate (x -4 Parent -* Parent) 

[End If] 

If(x -4 Parent -* Parent -4 Left -4 Color = Red) Then 
// Case 2, x’sparent is right child and its uncle is red. 

X -> Parent -4 Color = Black 
x -4 Parent -4 Parent -4 le/t -4 Color = flfacfc 
* "* Paren * -> Parent -4 Color = Red 
X = * "♦ Parent -4 Parent 
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* S P arent I s night child and x *s uncle is black 

(* = * "* Par cnt -4 Le/t) Then 
* = * -♦ Parent 
PlQhtRotate (x) 

[End If] ^ 


x -* 

X -+ 


Parent 

Parent 


Col °r = Black 
? Par ent cotor 


Red 





6 : 


Lef tRotate (x 

[End If] 

[End If] 

^od Loop] 

Hoot -* Color = Black 

Exit 


■^i^ced Tre*, 



Step 

If 

A'X Tree 

Su.de, in year .962 A binary search tree is 

U ofthe rrec m organized m such a way that the differencfin hSE^S 
,*ae and nght subtree of any node in the tree is less than or equal to one 

If die difference in heights of the left subtree and right subtree of any node in the B man 
Search tree becomes more than 1 then that tree is said to be unbalanced 

Id height balanced trees, additional field is associated with each node of the tree This 
additional field stores the balance factor ( bf) of the node. The balance factor (bf) of the 
oode is the difference of heights of its left subtree and right subtree. The structure of the 
node will be, 


,eft Info of Rif 


Left Info bf Right 

As ID the AVL tree, the difference between the height of left subtree and n 8^ su ^ ^ 
my node can be atmost one, so the balance factor < bf ) of a no e in an 

he -1,0, or 1. 

• The bf of a node will be -re if the heigh, of to left subtree is less to the 

Wght of the right subtree. js ^ „ the height 

* The bf of a node will be 0 if the height of its left 

of to right subtree. . , eft subtree is larger to the 

' The bf of a node will be +re if the heigh 
b^ght of its right subtree. 

nutshell, 


bf = 


f-ve if «t < H * 

0 f/Wt = H * 

+ve if ^ > H * 
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A Simplified Approach to Data Structures 




The following examples shows some binary search trees which arc baUnceT^^ 
trees as all the nodes in these trees have bf = 1 or - 1 or 0. 1 e. ^ 




The following examples show some binary search trees which are unbalanced i.e. the 
balance factor of one or more nodes is either less than —1 or more than +1. 


50 2 ' 3 " 



100 

Node 70 has balance factor bf = -2, so 
this is not AVL tree 


M * 2 50 



^ 2 $0 

Node 30 and node 50 have bf 
this is not AY'L tree 
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'V. 


' „ operations which arc commonly ap D H M 
ft* ii«* in _ These operations arc: ^ e ° n anv 


Adva 


need 


i^Stru, 


^ures 


.^rations which arc cor 
fM i" 4 " 1 , these operations arc: 
' 4 \t 

Search* 11 *? 
t insert* 00 

t pcJffhon 


also applied 


,j.l.l Swrth |n 8 

_ utreb opemiion is defined as finding the address of , , 

rh . The search operation on AVL tree is nodc containm* the. a 

e#*f Lt Th»c ic a \n T* “ a PP l, « d in the s.miiJ^ 8 «* d ««sd 

ipP l.ed ot 

lefisn 


tiod BbT - 1 h,S £ be " UL the AN L is basically h e ? g ht ba manncr 45 « «s 
bS D. Therefore, the complexity oi the search operationon a£? * blnar > 

n on Av L tree is 0(l 0 n^ 


°{log jn ) 

13.12 Insertion 

Insertion of an element in AVL tree is performed in the similar 
B$T That is. if the new element is smaller than the root element^ “ ‘ D Casc of 

lei) subtree else it is inserted into the right subtree. Care must be taken T mt ° *** 

nedt» AVL tree may result in violation of AVL tree pZenies A., mSer "°" of * 
*w node in AVL tree may cause the balance factor of a node in the tree to clZeTte 
Dun -1 or more than 1. In such case, there is a need to balance the tree so that no node 
«, the tree has balance factor other than-l.O.or 1. This balancing is done usma 
rotshons. 

To perform the rotation, we mark a node which is the nearest ancestor to the newly 
inserted node whose balance factor has become other than -1,0 or 1. This marked node is 
known as pivot node. Based upon the position of the newly inserted node, there are 4 
Opes of rotations. 

• Left-Left Rotation 
Right-Right Rotation 
Left-Right Rotation 
Right-Left Rotation 

et ^ ^ scuss these rotations one by one: 
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11 ini|''li^ A pP roaCi1 — 

Lett-Left be inserted in the left subtree of left child « f p , 

When dte new node.s.^ "H,, 

left-left rotation is pe" 2 ^ P 

inserts / \ . Ri ^ aH ®. 

" j 25 



25 


7B V 


°10^40 { 


h 5 

A. 


75 



/ 


J 10 40 


10 \ 

/ So* 

/ ,A 

40 75* 


AVL Tree 

*50 


Pivot Node P is 50 AVL Tree after r^d 
(Not an AVL tree) *" *<»*<* 


2 50 F 


u 25 



Insert 20 



u 25 


75 


A 

°10 40 1 


25 

A 

'No 40 1 

\ 


75 


Right Rotation 

. » 

No 



20° °40^\° 


AVL Tree 


20 w 

AVL Tree after Right Rotate 


Pivot node P is 50 
(Not an AVL tree) 


LLRotation (Root, P) 

Step 1: If P-> Parent - Null Then 


Root = P -> Left 
Else If P -»Parent -> = p 

P -> Parent -> Left = p _ Left 

Else 

[End H]"* >>arent Right = /> -. Left 
Step 2; re "tP = R -»i e r ( . 

Cp: l*ft = Temp 

s,e P * Return 


If Pivot node is the root node 
// If Pivot node is left child 
// If Pivot node is right chiiu 
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„# Bot»< ion 

»»* ,s '° ** “ “■' r| n»< .«b, r . 

fir & * * r0 tation is performed Mbtr< * of 


2 50 P 


rl|itH child ol 


Structure 


pivot 


nod* #» 


v 



Insert 120 


*J5 


A 


•w 10 <f 


aVU*' 


25 



75* 


Left Rotau 


on 


.A, 

60 loo 1 

\ 


120P 


Pivot node P is 50 

(Not an AVL tree) 



50 ' . 

A \ 
25 w ° 


Av l Tie* dtw Left Rdano,, 


-1 50 


* 2 50 P 


Insert 90 



75 u 


»/ 75° 

“► °25 75* 1 

A 

A., 

.A 

®60 100P 

60 100 1 
> 


°90 

AVI Tree 

Pivot node P is 50 


(Not an AVL tree) 

RRRotation (Root, P) 


Step 1: UP -> Parent 

= MuM Then 



100 1 

°25 60° 


AVL Tree after Left Rotation 


//If Pivot node is the root node 

Root = P -> Right 
Else If P -+ Parent -» Left = P 

P -> Parent -> le/f = P -* Right 
Else 

P-► Parent -> Right = P-> 

[End If] 


//If Pivot node is left child 
//If Pivot node is right child 


291 
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Temp ** 

r . Hlpht - Left 

/> . HI//hi - temp 

Return 


« A* 


Lrft'KItfbf Kottttion 

w ,„„ „, r new node Co be .n.dcd in the right .ubtree of the left 
limit v then left Right rotation >» per formed. 


child 




A V L Tw 


Pivot node P is 50 


Pivot node Pis 50 


Right Rotate 
▼ at Pivot nodeP 



AVL Tree after Left Right Rotation 
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AVITi*« 


Pivot node P ia 50 


LRRotatlon (Root, P) 


InftQlullOTl m j 

Step 1 : \{p -* Parent = Null Then 

node 


1 


Right Rotate 
atPwotnodeP 


40 



25 


50 


-1 


\ 


// // Pivot node * the r0 ° : 


Step 2 
Step 3 
Step 4 

Sl «P 5 

St «P6 


floot = P -♦ jj if pivot node is left child 

Else If P^> Parent-* Left sP . ht 

P -» Parent -»le/* = ^ “* //Pivot 15 n ^'" n ‘ 

E1SC Df - P - Le/t - 

P -♦ Parent -» ' Y 

[End If] . 

= t - le/t - *‘fl M - Rle 
P •* Left -»Sip/it -> *(fl w ~ P . ft 

p - un - - w« =; - ;y flW - 

p -*Left -> Right - P ^ le f l 
Return 
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Riffht'Left Rotation 

SSTihe «w «»* » » * amtUi ,n "* ,Ub ' r " r ' 8h ' Ch “ d 01 »« 

p thm Rigbi-U# rounon is perfonned 

S» X 

Right Rotation 


H 


V 



Imcrl 55 


AVI Tree 



A 


*25 * ~ 

A ■- 

5/ 

Pivot node P i* 50 
(Not an AVI Two) 


75 1 * Right child of P °25 



60* 


A 

Pivot nodePiiSt 


Left Route 
dt Ptv ot node F 


60 



50 


75 


° 25 ^ 55 ° 100 ° 

AVL Tree after Right left Rottf®" 


//If Pivot node is the root node 

is left child 



RLRotation ( Root.P) 

Step 1 IfP-* Parent * Null Then 

Root = P -4 flight -* Left 

Else If P - Parent - Left = P //If Pivot node i 

P - - ie/t = P -> Al^/tr - Left 

Ebe ////P/vo/ not* is right 

P - Parent -4 Right * P - flight - Left 

[End If) 

Temp = P - flight -4 te/t «* Left 
P Right -* Left Left * p 

p " »?'!'' W ‘ - - e -»m«ftt 

^Z:: L r: f :;^ Ri9ht - uft - RisM 
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Daw Structures 


a mplified 



Right-Left Rotation jn (he , efl subtree of the right child plvol 

■ v ' 

Ho y/V Right Rotation ✓'V 

Insert 55 / \ -► 0 \ 

75 1 at Right child of P 25 60 

A. A 

Pivot node Pis 50 


°25 75 


A, 

°60 100° 


AVI, Tree 


25 


*60 100 


/ 


55 

Pivot node P is 50 
(NotanAVL Tree) 


RLRotation (Root, P ) 

Step 1: If Parent = Null Then 


Left Rotate 
at Pivot node? 


60 



U 50 75 

/\> \ 


25 55 


AVL Tree after Right Left Rotate 


//If Pivot node is the root node 
//If Pivot node is left child 


Right -> Left 0 

//If Pivot node is rtg 


Step 2 
Step 3 
Step 4 
Step 5 
Step 6 


Root = P -4 Right -4 Left 
Else If P -4 Parent -4 Left = P 
P Parent -4 Left = p 

Else //IfPt\ 

P -* Parent -4 Right = P -4 flfoht -4 Ic/t 

[End If] 

Temp = P -4 Right -4 Left -4 Left 
P -+ flffl/it -4 Left -4 Left = p 
P -» Right -4 Left -4 = p ^ 

e = S P = 
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for an example of creation of AVL tree with p ,„ m 

35, 15, 20, 10, 300, 250, 150, 180*5 “ g,V “^ 

• __* Wa. __ J * W 


< 0 . 


***■ .... .. X 

clement will be inserted into the AVI t T ^ * a 
created L nee and:a. the end of I***, 


f^VL^ee is created. 


one 




1 : insert 


50 




sw 1 : insert 100 

50 




St «P4: Insert 35 
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•is 

Step 6: Insert 20 


2 



Step 7: Insert 10 




Scanned by CamScanner 








Scanned by CamScanner 





W V* 



MU Jfe 




1 


A Simplified Approach to Data Structures 


Step 10: Insert 150 
2 35 



15 


A 


# 10 20 


■2 
100 


.A, 

°50 2S0‘ 

, A 

1 200 300 

V 


150 


35 



R-L Rotation 


15 


-2 
100 


0 10 ^ 20 ° 0 -^S *1 


50 ^200 


A, 

150 250* 1 

300 * 


35 


Step 11: insert 180 

2 35 



R-L Rotation 


P 


A, \ 

0 150 ioo 



15 


200 


.A. .A, 

0 10 20 0 100 250 

.A \ 

° 50 150 boo 9 


-2 


15 


35 

100 


A A' 

10 20° "si 200 

A- 

■‘iso 

\w 3°°“ 
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Advanced Tree Structures 



Step 12: Insert 5 




Vay Tree imDroved variations a* "JJJJ 

have discussed binary search tr<*^ de s in the leftsub ^ t subtree of 
-tree. In all these binary Maccbtrees,« e , efflent and the n, 

5 elements which are smaller * ro ot elemen tree 

ains the elements which are larger th ^ 

of binary search tree can be g eneral ^ nar y search «**££*& P al ‘ 1 
shorter path lengths as compared tob^ ^ efficl ency 
aching, shorter will be the search p 
end upon the extent of branching* 
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| | u.^n^ta Structure 

-.,^n..af««»» tree in which each node has maxin^ 

A «Ju*ay -« ^ Aments in each node are arranged in ascen^ *'l 

element. and n J,„ tov « maxim am of 3 elements ,n each nod. ^ 

For example a-t-*ay «e *J' A general m-way tree has following property H 

may £13 VC flMTInMiP ^ ... . 

w maximum of m child nodes. 

• A3’* node L- « r _< elements 

' . s via . ~e< has maximum of m 1 elements. 

m each node are arranged m sorting order (usually ^ 

order, . . ,,a !U btree of an element will be predecessors of fe u 

* ^^fS^efei’att m the right subtree of an element will be successor! «f 

that element. ffee wtlch has f number of H 

L = n - 1, ' i - 1 


# 


intent 




10 


L 1 * 

>Wi 

1 



1X2U 







An m-way tree of order 3 

An m-way tree of order 4 is shown below: 



An m-way tree of order 4 
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v 


arc 


ulso height balanced trees and these m-way trees can be of 

1 <I|P»A /■> I n 


many types 


. n0 „ the maximum si/c ot each node. For example, 2-3 tree, 2-3- 
Nl tl ditJg “>♦ (rec etc l ft us discuss these trees in detail: 


W rtU»» , "‘ r 

h V * 6 

**** 


2-3 T ree 

• die simplest kind of m-way tree. This tree was introduced by John 
,A tree » 9 - 0 a 2 - 3 tree can have two types of nodes: 

‘ . r oft It > ei 


H“P C 


2- nodes 

3- nodes 


single key k and has exactly two children. The left child is the root of 

2-node tojs values are less than k and the right child is the root of subtree whose 
whose 


^“«^ rthank 



Left Child 
Subtree 


Right Child 
Subtree 


. has lw0 kevs k, and k 2 which are arranged in ascending order and has exactly 
*r« children The left most child is the root of subtree whose key values are less 
tank, The middle child is the root of the subtree whose key values are between k, 
and k 2 The nght most child is the root of the subtree whose key values are larger 

than Jtc 2 - 



~ 3 tree has the following properties: 

* Every node in the 2 - 3 tree must be a 2-node or 3-node. 

The key values in each node must be in ascending order. 

A31 the leaf nodes must be at the same level. 

The length of the path from root node to any leaf node must be same 
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7.4.1.1 Operations Performed on 2-3 Tree 

Various operations that can be performed on 2-3 trees are: 


• Searching 

• Insertion 

• Deletion 


7.4.1.l.i Searching 

Searching for a desired element/key in 2-3 tree is a very simple operation. Starting 
root node of 2-3 tree, 

same astiiaTof root’ll ^ * S performed just like the BST. If the desired I 

ot’s element theT^i^ searchln 8 is stopped. But, if the desired element \ 

“ - “ —• 

ita:iflittf 


than root 


search operation is continiSdto X'ri^uubt^ -- 

keys), if we get f ° r the desired key at the root node (node contat^J 

operation is continued to one of Procedure is stopped. Otherwise * e * , 

116 ° f ItS subtrees (left, middle or right). Co** 


302 
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Advanced Tree Structures 



f tK * pigment 110 in this 2-3 tree. 

Ld us search for th ^ f00t (2-node). As the desired 

-r— -* The 



Searching for key 


no in 2-3 Tree 


: Insertion lea f node. If** ^Vis not empty then 

Of a new key element the too. "«>*■ tree. While tnsemns 

tsertion of the new key “** 8 18 search operation 

priate leaf node is found «smg cases anse: the first key 

;ey in the appropriate leaf nod , ^ , s inserted » ^ |arg « Uian th 

If the leaf node is the 2 -node then‘ J neW k ey ts srr» 

or second key depending on wh *' ^ {olloWin g 2 

leafs old key. For example, cons 


Scanned by CamScanner 









For example, consider the following 2-3 trees 



The insertion of new key = 15 will be in the right leaf node. But, this «*** 
causes the overflow of the leaf node. So, this node is splitted and the ke>' 
are arranged as shown in the below diagram. Here, the right leaf node - 
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£'00^ 

ID 


.Advanced Tr^, 

r th e following elements which are inserted into the^ ^ 


]0 


30 


40 


50 


15 


20 ,r « on, by 
” 25 45 


It 



^0 

af 

is 

is 

). 

le 



3. Insert 30 


10 20 30 



4. Insert 40 



5 

) 

t 
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7.4,1.13 Deletion 

Deletion of a key value from multiway (2-3 tree) is more complicated as compared to 
deletion in BST. This is because we have to maintain the properties of 2-3 trees after 
deletion is over. Following cases arise when we delete a key from a node: 

^ We 1 J If the key element is present at leaf node and the leaf node has 2 keys then 
P^onn the deletion of the key from that node. For example, 
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Here, the successor key (25) replaces the key to be deleted. We could replace 
be deleted wit h the predecessor key which is 15 here in this 2-3 tree. he key to 


Case 3: If the key element is present at non-leaf node and its successor and nr 
node (definitely, the predecessor or successor node will be the leaf node) has i ^ 
key then redistribution is carried out. If either of this leaf node’s siblings conta^ 01 * 
keys then one key is moved up to the parent node and one key from parent node ^ 
down to the leaf node of successor key. For example, 


moved 





I 



l 8 " 4 : ^ the Jce> element is present at non-leaf node and its successor and predec 
vJjfTl h predecessor or successor node will be the leaf node) has onb 
then the rw ? f Ut !? n 1S out - ^ b °th °f this leaf node’s siblings contain on< 

be colmed m f" CS “ d 1 ""** key which 18 *> b * taken from their parent nod* 
the parent node then 2 th^ ^ n ° de ' tbis mer 8‘ n 8 causes the underflow conditi 
example, 1S mer ^ in ® P rocess is propagated to one level upward 
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Delete the elements 58,60,10,30, 35, and 32 in succession. 
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3. 


Delete 10 (Case 3) 




4. Delete 30 (Case 4) 




£ 
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7 - 4 - 2 B - Tre ;. way «. p —- 

R. Bayer and E. con ^ ins a very large numb ^ not be sufficient to 

- S. of -He - w 

ValU “ S ore Tan one^y dependmg upon the order of the B-tree. 

contain more than on . ,, R . tree was due to the following factors: 

The motivation for the developmen memory 

. indexed structures for large dam sets cannot he stored ,n = . 

. Storing these indexed structures on disk requires 

efficiency. . ^ n place in 

Suppose a disk rotates at 3600 rpm this means one ro suffic ient to 

1760 th second (here it must be noted down that 1/60 secon 
execute approximately 20,000 instructions) - 

Suppose, we have 20,000,000 records and we use AVL tree to store 

these records. The depth of the AVL tree will be ^ g^out 

lo @2 (20000000) = 24. So, the total disk accesses will consul 

sb o.4 seconds. 

i *•/•*« is to tB* 

reduce the height of the AVL tree, so the only solution 
i which will eventually reduce the height i.e. 

More branches - ' J —*** 

B-tree is the solution to this 
tables residing in 


V 60 / 



\ OU / 

As we cannot reduce the height of the 
more branches which will eventually re< 

More branches -.- ^ Less depth 

B-tree is the solution to this problem and are widely used for representing - 
tables residing in secondary memory because. 
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v ^ncec j Tree St ru e 

with a Urge branching factor m, height of B-treeid '- 

a,sk accesses. Also as m increases, the amount of " W r ' SUlUng m few « 
„ode increases but this computation cost | s ne( . lj „ i| 7. com P“t8hon at each 
disk accesses. g 8 e 48 com Pared to hard 

rhe branching tactor m can be chosen such that a nr a 
• b | 0C k of secondary memory. node corresponds to a 

fofdcr m has following properties: 

Each node of the tree except root node and leaf nodes, has maximum of m 
children and minimum of - children (Here, = is the integer division, 

In other words, each node of the tree except root node must have maximum of 
m - 1 keys and minimum of — - 1 keys. 


ijl nodes in B-tree must be on the same level. 

, The key values in each node are stored in ascending order. 

• The key in a node separates the ranges of keys which are stored in each child 

node of that node. 



B-tree of order 4 

* B-tree of order 3 is known as 2-3 tree and a B-tree of order 4 is known as 2-34 tree 

^points to be remembered about B-tree are. 

Maximum number of elements in B-tree of order m and he g 


^vel 0 contains m — 1 elements 
^vel 1 contains m x (m — 1) elements 
^ Ve l 2 contains m 2 (m — 1) elements 
3 contains m 3 (m — 1) elements 
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A Simplified Approach to Data Structures 


Level h contains m h (tn - l)elements 

Total number of elements =(l + m + m 2 +m 


■ m h+1 - 1 


+ )(m M) 

For example, a B-tree of order 5 and height 2 will have m • 
m k+1 - 1 = 5*^ - 1 =124 elements aXlmurn 

-tree of order 101 and height 3 can hold approximately 103 3 +i 
L 4 - 1 = approximately 100,000,000 items. Any of these items ' 1 * 


of 


A B 

101 4 - 1 = approximately 
accessed in maximum of 3 disk reads. 


can be 


7.4.2.1 Operations Performed on B-tree 

The basic three operations that must be performed on B-tree are: 

• Searching 

• Insertion 

• Deletion 


7.4.2.1.1 Searching 

The onlv^differenre ^ ® _tl ? e * s s * m ^ ar to searching the key in binary search tree 

** child (ta » 

for each node and henro a u** ,S order 4 then we have maximum of 4 childrei 

is chosen by performim? a choice t0 move t° one °f the 4 children. The correct chili 

of order 4. mear searc h °f keys in a node. For example, consider a B-tre 


Suppose ' J — J MH usl |l 60 |l 80|200 

wc want to f h k l__ 

!45 ^s^resent betw thC ^ Values rootn pr0CCSS starts from thC 

child node ao a - I 66 ” ^eys 1Q 0 and 150 node !s Performed. As the desir 

we hud the desired^ '*** Search 0n 10 3r<1 child ofth,S r00t 11 

desired key value in this node '** ° fthls n °de is performed. 
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_ A ' : '«■’ **4 7 .. 

rtinn 1 

' . j.2 iDserOon 

„ f , pew key “B-tree always uJcM Piatt , rj!i> 
m suet a manner that after insertion 4l) ( . -Wv A 

J*** 1009 «W * CT ** '»**•<"• * tf* „ , £*" *•< - •«• -• -*., M 
;-a<2, t00t empt> then the typropnatc !«rf ,, .,j / ^' ■>- -v, 

jf^inse"hile *»*™»8*e newkey ,n theappro-. ^ 

^^ippropnate leaf node is not previorcy t, . . 

• to leaf node in proper sequence and done For t,*,#,. £', "T"* 

B .tree of order 5 Me Mm*! 



The insertion of a new key = 15 will be ;n the eft .eaf v/ie >... . fe.. *; * 

resulting B*tree after insertion will be 



If the appropriate leaf node is full (\ e it contra .r. . 

can have) then it is splitted into the two nodes on the wrr.c l«<*. ^ 

ke>' is sent up the tree into its parent node . '.s pTomoU'.r. j. • 

the parent node may cause the parent node s o-ert»o** /7,7> 2a V.e 

again splitted to two nodes with same procedure .c. 

following B-tree of order 5. 


20 40 


5 8 10 15 


70 SO 


xv w^ ry JS *> "A! 

h>*emonofkey = 12 will be in the leftmost leal'®* paw**" 

» H splits into two nodes and the middle key. - • •' -. 



*s | £ 
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a Simplified Appro ach to Data Structure^ 

Consider Ihe following elements which nre to be Inserted into the B-,r„ 
one bv one. 

5. 35. 30, 10. 55. 20, 40. 65, 50. 25, 85, 45, 80, 100, l 5 , 

90. 95’, 75 


1. Insertion of 5,35,30, 10 

These four elements will be inserted into the root node. 

3 10 30 33 


2. Insertion of 55 

55 is being inserted into full node, so node split will take place 
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*■ Inwrtton of 60,70,90,95 
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7.4.3 B+ Tree 


The most well known variation of the B-tree is the B+ tree. B+ tree is also an m-way tree. 

B~ tree of order m has following properties: 

• Each node of the tree except root node and leaf nodes, has maximum of m 
children and minimum of y children (Here, y is the integer division). 

• In other words, each node of the tree except root node must have maximum of 
m - 1 keys and minimum of y — 1 keys. 

• All leaf nodes in B+ tree must be on the same level. 

• The key values in each node are stored in ascending order. 

• The key in a node separates the ranges of keys which are stored in each child ot 
that node. 


• All the internal/non-leaf nodes contain only the keys not the data associated 
with these keys. Data can be found only in the leaf node. It means, to find the 
data, we have to travel to the leaf node. ' 


All leaf nodes are linked together 







be accessed sequentially. 

^uentiallv^Bein^^ re ? rds rec l uired to be accessed randomly as i 

jStTke the lZ “ ar " Structure > ** records can be accessed rar 
be lWf n ° deS linked ^ther as a doubly linked 

example, consider a s tude S ®? uentia '^ * n forward direction or reverse directs 
student can be accessed in ”, S . r ® cord . s y stem m a university. Individual record 
be prepared, then the batrh ndCX V16W ' When ^e result of the students is req u 
linked list of the leaf nodes Pr ° Cessmg can be done in sequence using the t eal 
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B+ tree 

Various operations like search, insertion, and deletion into a B+ tree are nerfrrm a 

*** ® **?■«*' W,h 3 S , ma ‘‘ °5 e tha * a “ «•>* operations occur in the leaf noto 
»bere tbe key-data pa.rs are stored. For example, to insert a new key^ata pair into^B+ 

tree, 


1. First of all search the B+ tree to locate the block to hold the new key 

2. If space is available in the node then store the key-data pair in the respect,ve 
place in the block and stop the process as key-data pair has been inserted 

3. If the node is full then a new node is created. Keep the first £ keys in the 
existing block, and move the remaining £ keys to the new node. 

4. Update the 3+ tree’s index to link the new node into the index. Here, updation is 
performed just like the insertion of a key in the B-tree. 

5. The newly inserted node is leaf node, so this node is linked to the previous as 

well as the next node in the same level to retain the linked sequence of the leaf 
nodes. 



„ "-— v /1 U-UCC nun jdt tree 

JMreT 

B+ tree 

■ ^ ave associated with interior 

*s as well as exterior nodes. It means, 

node 030 ^ ^ 0UnC * at an y non “l ea f or l ea f 

1 

B+ trees do not have data associated 
with interior nodes. Data can be found 
only in the leaf node. All the interior 
nodes contain only the keys not the data 
associated with these keys. 

So, B-tnlj, 0068 trees are not linked, 

everv u, \ . Wou ^ require a traversal of 
nevel in the tree. 

^STiS'r: —— _ 

The leaf nodes of B+ trees are linked 

just like making it a linear linked list. 
So, a full scan of all nodes requires one 

linear pass._ —-- r-~ 

B+ trees are much easier an^ hig 
performing to do a full scan. 


Cac he misse Ve f Sa ^ involve more 

W 8 ^n a program accesses a 
s ^!led a ^ at is not in the cache, it 

































. .... . 

" Hiirw ironm.,; "tin tn vv.il, rail, kry _ „„ 

‘l ucnl ' <u leaned nodes t un hr (lone, to 

>C and thcicloir ntn hr »cccmmo «1 

ou*tr quickly 


1 he li tier irc|uncs less Mningc (the key 

'allies aic stoicd only once) 


7 u 
•-ver. 


In taur ol lit lire, dal;. W(t |, c;i( ^ 
alwnys present in the lea) 

I he frequently uccesscd nodes w ,jj - 
leal noiloa Aw all the leal K 

the same level, so access to ariv r„ " 
equally likely ‘ ' n 

Mir lit lire requires mo/c ^;ayr 
key values may he sto/cd more th-* 
once 
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^-^—iiaai-isa;. 

do you mean by height balanced trees? Discuss. 

YSrTiat is Red-black Tree? What are its characteristics? 

, wliat is A VL Tree ? W hat are the characteristics of this tree? 

4 What is balance factor 9 How it is useful in the operations on the tree? 

Create the Red-black tree of the following elements. 
l50 140 130 120 125 122 110 100 105 
p Create the AVL tree of the above mentioned elements. 

7 What is 2-3 tree? Write down its characteristics, 
g what is B-tree? Write down its characteristics. 

9 What is the significance of the height balanced trees on the search operation? 

10. Create the B-tree of order 3 using the above mentioned elements. 

11. Explain the various rotations performed in creation of AVL tree. 



(Questions from various Universities previous Examinations) 

1. Show how the following trees will be built when the values (A, V, L, T, R, E, I) are 
inserted in them 


2 . 

3. 


4. 

5. 

6 . 


a. Binary search tree 

b. Heap 

c. AVL Tree 


Write an algorithmic function heights_correct(x) that returns TRUE if and onl> if all 
the heights fields of the AVL tree x are set correctly, and FALSE otherwise. 


ow how the following trees will be built when the values (B, Z, Y, C, , 
erted in them 
Binary Tree 
Binary search tree 
Heap 

AVL Tree 


an AVT tiw? Hnw halancinc is done in 


AVI. tree? Explain with example 


are AVL trees? What are its advantages? tree are represented 

H °w an AVL tree differs from a binary search tree 9 How A\ L 
ln computer memory. 
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7. 


Is the following tree an 

A 

\ 

C 

/ 


(Multiple Choice Questions) 

1( , arv trpe e verv internal node has exactly k children. The number 0 ( 
1 In a complete k-ary tree, every u«o / fiATP r <,. 

eaves in such a tree with n internal nodes is. (GATE CS 2005) 


A. nk 

B. (n- l)k+ 1 

C. n( k -1) + 1 

D. n(k-l) 

2. What is the maximum height of any AVL-tree with 7 nodes? Assume that the heigh, of 

a tree with a single node is 0. 

A. 2 

B. 3 

C. 4 

D. 5 


3. Which of the following is true about AVL and Red Black Trees? 

A. In AVL tree insert() operation, we first traverse from root to newly inserte n ^ 
and then from newly inserted node to root. While in Red Black tree insertO, * 
only traverse once from root to newly inserted node. 

B. In both AVL and Red Black insert operations, we traverse only once from ■<* 
to newly inserted node 

C. In both AVL and Red Black insert operations, we traverse twiceL first travers 
root to newly inserted node and then from newly inserted node to root 

D. None of the above 


4. Which of the following is true about Red Black Trees? th , 

A. The path from the root to the furthest leaf is no more than twice as long 
path from the root to the nearest leaf 

B. At least one children of every black node is red 

C. Root may be red 

D. A leaf node may be red 



->• Which of the following is true 

A ' lausf™ tree ! are m °: e balanced spared to Red Black Trees. 

B. Heja&tsof AVi* 10n .-i * nse rtion and deletion. 

an Red-Black trees are generally same, but A^ L 
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alified App roacn w - 

9 ^A* Ch AHScAnodes contain the 

of black nodes. 


same 

of black nodes. . . 

B. All the paths from a node to its descendent leaf nodes contain the sum, 
of red nodes. 

C. Both A and B. 

D. None of these 


n M et 


oflo 


'8 as 2 i 


in 



10 What is the worst case possible height of Red-Black tree? Assume base 

all options 

A. 2 log (n+1) 

B. 1.44 log n 

C. 4 log n 

D None of the above 

11. Black height is 

A. The number of black nodes on any path from root node to leaf nodes 

B. The number of black nodes on shortest path from root node to leaf nodes 

C. The number of black nodes on longest path from root node to leaf node 

D. None of these 

12. The operations search, insert and delete on red-black trees have a time complexity of 

A. 0(log n) 

B. O(n) 

C. 0(n log n) 

D. None 

13. A binary search tree whose left subtree and right subtree differ in hight by at most 1 

unit is called. 

A. AVL tree 

B. Red-black tree 

C. Lemma tree 

D. None of the above 

be the number If iS a tIee * n eac ^ noc * e ^ as n children or no children. Ld J 

be the number of internal nodes and L be the number of leaves in a complete n-arytree.H 

L 41 ’ and 1=10, what is the value of n*^ 

A. 6 

B. 3 

C. 4 

D. 5 

15. Maximum number of elements in R T r » fl r , 

A. m A +i _ 1 ts ln B ' Tree of order m and height h 


B. 

C. 


m n - i 
m h 


None of the above 
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Chapter 8: Graph 



1 introduction 

. rtt p f introduces an important non-linear data structure 
c “Ljneenng domains in which this data structure fin& its T !“ re « 

Graph has applications in various fields like electrical and” 5 1 ™' <1<lla 
«“P u,er ScienCC ’ gameS ' and **** geographical mfonna„on“ 


eng 10 ' 


Historically' graph theory was originated in Konlgsberg Bridge problem by Leonhard 
rder a mathematician who developed some concepts in solving this problem Later 
L e concepts become the basts of the graph theory. Frequently, we use graphs as a 
^odel for the illustration of various practical situations. 

Is ibis chapter, we will start discussion with the terminology associated with graph and 
to we will discuss the memory representation of the graph. We will also discuss the 
various operations and algorithms related to graph. At the last, various applications of the 
graph will be discussed. 


8,2 Graph 

A graph G consists of finite set of vertices V c and finite set of edges E c which can be 
denoted by a tuple G = ( V G ,E G ). Here, the set of vertices V G represent the entities 
which has names and some other attributes. An edge connects a pair of vertices an 
represents a relationship between the two entities. A graph may be pictoria y represente 
as shown in figure below: 


c 
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ex ampi t 


Hie 


A Simplified Approach to Data Structures 

In this graph, vertices are labeled using letters a, b, c, d, and e. Theref 
{(X, b,c f d,6} 

E 0 = { ab,be,ed,dc,ca,bc,ad } or 
E 0 = {el,e2,e3,e4,e5,e6,e7} 

In this graph, edge between two vertices can be written in any order F 
edge between the vertices a and d can be written as either ad or da ° r 

8.2.1 Graph Terminology 

Let us understand the following terminology related to graph data structure- 

Directed Graph 

In the previous figure, no directions are associated with the edges of the cranh 
graph is an undirected graph. The edges of an undirected graph are rLLm^ 
unordered pair of vertices. In case of directed graph shown in below figure ‘ 

assigned a direction or we can say that each edge is identified by an ordered paf! 
vertices in the graph rather than an unordered pair. ^ 



A Directed Graph 

Outdegree and Indegree 

td 


from t 


vertex V. Similarly, indegree of a venev V * the " Umber ofed « es s,am ” 8 * 
terminating an;. I„ , he graph . » ln a directed graph G is the number of 

outdegree = 1 . The vertef /has indem^-T 5 ^ lgUre ’ the vertex a haS indegre ‘ = ‘ 

Source and Sink 

A vertex v is known 

*®0-Similarly, a ootdegree is one or more than one but its ^ 

d »sree is zero. Following fiL."" Slnk ,f its indegree is one or more than one - 

presents source and sink respectively-’ 
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n-de d is source and node a is sink 


A****" 1 ' A* he .diacent if there is a direct edge between them In a graph G. 
IW vertices ^ ,d ‘ 0 ^ ia£em w vertex v, if there is an edge between v, and P, 
a vertex P, sai- c e ^ vertex a is adjacent to vertex b. 

J£ JE “a^r * but vertex h , no, adjacentto vertex a. 


' graph a path from a vertex v< “UjTto A P ath wilh * 



is a path 
is a path 

is a path t 

is not a path as a and e are not adj 
is not a path as b and d are not adjacen 
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ASimplifiedA££roachJoDataStructures_^^___^^^^ 

A path is said to be simple if all the nodes on the path are distinct wit- 

starting vertex and terminal vertex should not comcde. For example, i„ the f 

above: "S 

ab e dc is a simple path 
ad e b is a simple path 
abe is a simple path 

A closed path is a simple path in which starting vertex and terminal vertex are same 
the condition that there should be minimum three edges in the path. A closed path is ^ 
known as cycle. In the figure shown above, 

abc a is a cycle 
abedca is a cycle. 
acda is a cycle. 

A path is said to be Hamiltonian path if it contains all the vertices in the graph e.g. 
figure shown below: 




A Graph with 4 Nodes 


a -> b -+ c -+ d is a Hamiltonian path 

An edge is called a loop when its starting vertex and terminal vertex are same A simT 1 * 
graph usually does not allow loops. In the graph shown above, the edge 65 is a loop a* ~ 
initial and terminal vertex is same i.e. b. 


A graph G is said to be connected if no node in the graph is isolated. In such case, it * 
graph is undirected then every pair of nodes in the graph will have a path. For exa®? 4 


consider a graph having 9 vertices a, b, c, d, e, f, g, h, and l. 


) 


b 



An Unconnected Graph 


O 


« 


s 
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not connected as there is no path between anv of tu 

T f he « raphSh f ° t * n ,nne «figure isconnectVr'? f e h i ^ 

& jut* . ^1 pairs of vertices of the graph. KW Sraph as the re wists 

$be**** * 



A Connected Graph 

. graph G is called strongly connected, if there exists a path between each pair 
A Vertices. For example, if there is path between the vertices v t and v h then there 
i-Q ^ a path between Vy and v t . In a strongly connected graph, there must not be 
"^source or sink vertex. Consider the graphs shown in figures below: 




A SM* CPS 

The figure a is a strongly connected graph as there is 

u a weakly connected graph as there is no edge sta ing desired 

A graph G is said to be weighted if edges in it are assign^ 8 . For example, the 

10 re P r esent certain physical attributes/properties y ^ts. g ere in the graph, e 

^ of the graph shown in next figure are asslg , tween the cities, where the vert ^ 
assigned to the edges represent the hted graph, an edge is repress 

^ graph represent different cities. In case 

. *u,» weight of the 

1 5 , . making an edge and w is * 

( v i.v 2 , w] where v l9 v 2 are the vertices m 
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A graph G is said to be multigraph if it contains multiple edges or loop in it, p 0r 
example, the graph shown in figure below is a multigraph as it contains a loop at vertex c 
and multiple edges between the vertices a and b. 





A simple graph does not allow any loop or multiple edges, or cycle in it. 


8.3 Memory Representation of Graph 

SjJJv a* 0 ^ r *P resent *d ' nt0 toe computer memory using various ways, 
standard approaches for representing graph are: 


The 


Sequential Representation by using the adjacency matrix 
• Linked List Representation 


Adjacency Matrix Representation of Graph 

Suppose G = {V E 1 i« a a- 

by using v v v 2 ,v^,v d . & ^^J^Ph having n nodes. Suppose, vertices 

square matrix of orde^n such that- Then ^jacency matrix A for the graph 



aiJ "i q edge lies between the vertices Vi ctnd Vj 

ere is no edge between the vertices Vi ^ V) 
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y G s {( a,b,c,d,e } 

Yhf adjacency matrix corresponding to this ordering sequence will be: 

d 
0 
1 
1 


a 

b 

A s c 
d 
e 


a 

0 

0 

0 

0 

■0 


b 

1 

0 

0 

0 

0 


c 

1 

0 

0 

0 

0 


0 

1 


e 

ll 

1 

0 

0 

0 


. . _u the adiacencv matrix will be symmetric, as there wib re 

In case of undirected graph, J • the Krap h To represent an undirected 

entries in the matrix corresponding ith ^ ^per tnangular or the 

using the adjacency matnx, “ to figTbelov, 

lower triangular matrix. Consider an undirected gr p 



A Undirected Graph 


** * t a 'h.c,d, e) 


Recency matrix for the above shown undirected g»P 




be: 















A Simplified Approach to Data Structures 




A weighted graph can also be represented into the computer memory using ^ 
matrix representation. In case of weighted graph, the weight of each edge 
graph is stored in the respective row and column of the adjacency matrix. In the We , 
graph, an edge can also have zero weight. In this case, we have to use some sentinel vai. 
r _akcAnrf. nf eHcxe Consider a weighted graph as shown hpio«,. * 



V G = { a,b,c,d,e } 

The adjacency matrix for the above weighted graph will be: 



a 

b 

c 

d 

e 

a 

r0 

4 

5 

0 

6 1 

b 

0 

0 

6 

5 

5 

A = c 

0 

0 

0 

4 

0 

d 

0 

0 

0 

0 

0 

e 

L0 

0 

0 

4 

0J 


8.3.2 Adjacency List or Linked Representation of Graph 

is possible to represent graph in computer memory with a variety of dt fter - : ^ 
structures. One way is to use the adjacency matrix which we have already discus* 1 " 
the previous section. The adjacency matrix representation has a number of dra****’. 

XrLTr'T’I' “ diffiCUlt 10 St ° re additlonal information about the 
stonnual ?"* ^ pr ° blem with * ls representation is its static nature B 

ZZ 7 ,fZ ’ a a f eMSSary 10 fmd “» ” umb er of vertices in it. « ***** 
difficult to insert and delete the vertices from the graph when it is represented 
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.^presentation, the space for the each Poss.bl,^^^ 

^ns.der the case of a graph C with n vertices L'" ' he *"*Ph is 
t^i'd »the n 1 entries in its adjacency matrix A and t “ Sma " numb « of 1, F ° r 
Hence, a huge amount of space is wasted So" k m “ nx A w '» deni? 

*£Z * ** WitH large numb « of vertices which ?*"»** is S 
^ number of edges. connected by very 

’ nther method for representing graph is us ing Unk . 

lesentatton, each vertex in the graph is a node in a master link* ln thls 

2 starts from each vertex node and denotes the vertices which are dirltwl 

given source vertex. This method, often called an adjacency list, is more spa^ffil' 

ian the adjacency matnx representation. Consider a graph C shown below i„f^‘ 

below: 



Graph 


Adjacency list of Nodes 

a -* b 

b-*c, e 

c ->d 

d —► b 

e-»a,d 


-► 

a 1T 

•— -*| b Null 

Ve 

itexa 1 

Edge (a, b) 

l b T 

-- Mj-Q” 

Vertex b 1 

Edge (b, c) 


hit 

pH~ d M 

Vertex c 1 

Edge (c, d) 


\ a \ m 

1 4-4 b M 


e lNull 


Vertex dl 


Edge (d, b) 


Edge (e, a) 

Adjacency List Representation of Graph sh 


d |Nnlj 
Edge (e, d) 

in previous fig ure 
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A Simplified Ap proach to Data Structures 

8.4 Operations Performed on Graph 

Various operations that are performed on graph are: 



• Traversal of a graph 

• Insertion of a vertex edge in the graph 

• Deleting a vertex edge from the graph 

• Searching for a vertex edge into the graph 

Let us discuss these operations on the graph in detail* as follows: 


8.4.1 Graph Traversal 

The most fundamental graph problem is to traverse every edge and vertex in 
systematic way. The basic applications of graph traversal algorithm include- * ^ ® a 

• Counting the number of edges and vertices. 


• Identifying the connected components of the graph. 

• Printing or validating the contents of each edge and vertex. 

• Finding paths between two vertices, or finding cycle in the graph. 

• Cop> ing a graph or conversion between alternate representations. 


t-Arra SZgZ. 2«' Each - . 


• v™, „ Suw . ^ 0(tj ^ 

processed.^' CC l lDlscovered State) - the vertex is encountered but not y 

• Vertex in black color (Processed State) - the vertex has been processei 

traversal,' die statTofS vertexTrow W * discover il So, over the coin 
discovered to processed P grasses from undiscovered to discovered i 

yet processed. Initially, only sincl!^^ ^ e . vert ‘ ces that we have discover# 
process a vertex, we must evaln^ ^ ertex is considered to have been disco' 
undiscovered vertex, we^ark k^ ^ 8 0in 8 out of it. If an edge go 

scanned oy faflfgcM" - “ ■** * - --* - 
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. ,% ruit /rr* 'jVrirA t .. 












‘I 


I'"- - '••.»t.,,^,. •' ■•’ ■> 


* '-/Vl v> 


■ -'- } V, 

J**'”' «fc«.b « W 1 "’' **' '>epend. it, „ , 

„ <**£,*preceded verticoa There ate two 


inSt Q ueU<! 

a, vefticc* 0 * Ftwt In Fmt Ou i) order it. queue, we exploit 1 m 
V, ' .' e( j vertice* firet Thu;-., our exploration* radiate out slowly feorr. t« 

^ ^ mn g a vo-callcd Breadth-Hrit I raversaL 

' ..^2 ° 


'.o vertex 

f /ua| *" 


1 iiD2 S wck 

1 .V 'erticei in a Last In First Out (LIFO) order i.e. Hack, we explore the 
fc. " ie along a path, visiting a new neighbor if available and backing onl; 
^ by moving * previously discovered vertices Thus, oar explorations 
*• * oar sprang porn., detang a called Dtptb-FV,, 

ptif •*& a '“ ; 

graph (directed or undated, traversal techniques wtddy mi are 

. Breadth-First Search (BFS) 

• Depth-First Search (DFS) 


i ae newly visited vertices have nui ^ r n hst is mc *. - .. ne - 

^ list of unprocessed vertices. The . vertex is * presentation. 

^ploraaoBcontmues until single unexplored ; sfflntard queue repre- 
**«. «. as a queue and can be represented using ^ Tr ,«r«l *«* 

'torithm: Traversal of a graph using Breadth 

, SS" 

1‘. Initially all the vertices of the grap ^ graph to 
Change the state of the starting %erte 


U 


into the queue Q. 
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a g^Hftotd APProar H to Data Structures 

Repeat Steps 4 to 5 While the queue to not empty 

Remove a vertex say v which is at the front of the que ue 
state to Processed C N 

Repeat For all Undiscovered adjacent vertices u, of vertex „ 
u, is set to the status Discovered and added to the q Ueue 

[End Loop] 

[End Loop] 

Step 6: Exit 

To understand the working of breadth search algorithm, consider 
*ua anH its adiacencv list. Suppose, we want to stan 


l fci 


Step 5: 


To understand the working of breadth search algorithm, consider a graph C sho 
the figure and its adjacency list. Suppose we want to start the traversal ** 
rf then it will act as the starting vertex for the breadth-first traversal. 



Adjacency list of Nodes 
a —* b 
b 
c 

d 
e 


e 

a, e 
c 

’ a, d 


Change the state of starting vertex d from undiscovered to the discovered by painting it 
with grey color and put it into the queue which is initially empty. 



123 4 


5 6 7 



Front a l 
Rear ■ \ 
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rtex d from the queue and change its state from discovered to the 
V^ v e the ve ^ j t ^th Black color and add all its adjacent vertices into the 
v "*l^ ***** ^ ^discovered state. Here, the undiscovered adjacent vertex c is added 

(^^> cb afe m 


<£#>*** 



Visited: d 


Front * *■ 

zi sx& “ s - sr,« » 

Severed adjacent nodes -^ ^ ^ in alph abe«c order. 

aided in the queue in any order du 



1 2 3 1 


5 6 7 - 


Visited: d, c 


Front-3 R«' - 4 state from the d,sc ^j^» 

'< the vertex from the front of the ***£%£* still in vertex d * 

•cessed state. Add all its adjacent vertices^ ^ ^ discovered» 
eue and change their state from un is a( j ( jed i nt0 lhe ^ 
and its undiscovered adjacent v e 
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Visited : d, c, a 


1 2 3 4 g 6 7 

| d | c I a | e 1 b | J_J 

TT 

Front-4 Rear-5 

Now. remove the vertex e which is at the front of the queue and change its state to the 
processed state. The vertices which are adjacent to vertex € are vertex fl and d. But, both 
of these are already in processed state. So, no vertex will be added to the queue. 



3 


2 3 

nn 


4 5 6 7 

urn 


f. 

PronT■ 5 

Re*r ■ 5 


Visited: d, c, s, e 


Remove the vertex b from the queue and change its state from discovered to 
processed. Add all its undiscovered adjacent vertices into the queue. The only vertf^ 
which is adjacent to vertex b is vertex e, but it is in processed state. So, no vertex will 
added in the queue. At this stage, queue is empty and no vertex is left unprocessed, 
we will stop the process here. 



Visited :d,c,a,e, b 
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,tions 


of Breadth-First Search Algorithm 


. ^ archetype for many important graph algorithm* , 

an on** 11 1S USCd t0 tmd lhe shortest Path in net^rks^V^ has several 
-? li:3 ntatl0 ns of the Bush fire algorithm. ks and ,s also used in 

^^AMlyhofBFS 

4.1,.first search algorithm, all the nodes of a level mmt h* e „ a,*- 
!3 - re h .j nodes in the next level have been discovered. Therefore the 8™°°^^ U ” til 
JJlJSU* *»rch is propomonalto the number of nodes at the deepest'le“ P 'f X £ 

leeching f« tM of the " b and dep ‘ h of the 8 raph jf <*• *en the space complex,ty 
"u tat* of nod “ at the J deepest leve ' "“is O(b-). Here, it must be mentioned 
L branching factor of a node is the number of child nodes it has. That is the outdegree 
; f a node is the branching factor. In case, the branching factor is not uniform for all the 
*des, then the average value of it is taken. 0 (b d ) is the space requirement of the 
^onthm when the number of edges and number of nodes in the graph are not known in 
Advance. When the number of vertices and edges in the graph are known in advance, the 
space complexity can also be expressed as 0 ( | E | + | V |) where | E | is the number of 
iiiis. and | V | is the number of vertices in the graph. 

in worst case, breadth-first search has to consider all paths to all possible nodes. 
Therefore, the time complexity of breadth-first search is 1 + b + b 2 + b 3 + 
...y which in Big 0 notation comes out to be 0(b d ). Also, as every vertex as well as 
every edge of the graph is to explored, so the time complexity can also be expressed 

as 0 ( | £ | + | V | ) in the worst case. 

8.4.1.2 Depth-First Search (DFS) 

h general, depth-first search is more useful than breadth-firstsearch.adead 

& depth-first search is, starting with a vertex s, it first o j another path 

«'<• ^ng a path P, now backtrack on P and search 

*S f from start to end and so on until all the vemces have been expior 

w< *“ ca “ be best described recursively. u eadth-first algorithm 

algorithm for depth-first search is very similar 10 “ 
e *oept that it uses stack to hold the unprocessed discovered vertices. 


339 
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A Simplified Approach to Data Structures 


Algorithm: Traversal of graph using Depth-First Search, t 


vertex 's' 

Step 1: 
Step 2: 

Step 3: 
Step 4: 

Step 5: 


lscov «re,, 


Step 6: 


Initially all the vertices of the graph G are set with the status U n( jj 

Change the state of the starting vertex s of the graph to Disco • * 

onto the stack 5. Vere( * and 

Repeat Steps 4 to 5 While the stack is not empty 

Pop a vertex say v which is at the Top of the stack and cha 

to Processed. n ^ e 

Repeat for all Undiscovered adjacent vertices u t of v 

u t is set to the status Discovered and pushed to the stack S 
[End Loop] 

[End Loop] 

Exit 


Pat it 


To understand the working of depth-first search algorithm, consider a graph 6 sh»«- 
below in the figure and its adjacency list. Suppose, we want to start the traversal far 
vertex d then it will act as the starting vertex. 



Adjacency list of Nodes 
a —»b 
b —► e 
c —»a,e 
d —> c 
e —>a, d 


GrSwlora^id niisb Vert f X & fr ° m undiscovered t0 the discovered by painting it with 
Grey color and pushing it onto the stack which is initially empty. 



-Top 


Stack 


P P the vertex d from the top of the stack and change its state from disc° >er ^ 






| 
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from the top of the stack and change its state to the processed sate 
Xow.poP* 6 vertices which are in undiscovered state to the stack by changing 

and push its ad J ace ™ vered t0 the discovered. Here, undiscovered adjacent vertices a 
J U •» ' *£%£*The order of these adjacent vertices may be taken any but 

JjflBvTtaken the alphabetic order. 



-Top 



Visited d, c fr m the discovered to the 

Pop the vertex e from the top of the stack and c ^^ one of ^em is in undtscovered^aw 
processed. As its adjacent vertices are a an » cesse d state), so no vert 
(vertex a is in discovered state and vertex 
Poshed onto the stack. 
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Visited d,C« 

... . ; c ar t he too of the stack and change its sta^ to protend 
Now, pop the vertex/*’ w venex a 15 vertex b which is snU m unttscc*.*?v. 

state. The vertex wnicn is J ■ change its state from undusovenc t * 

state. So, push the venex b onto the sta.x anu 

discovered. 




Pop the vertex b from the top of the stack and change its state from discover j 3 ^ 
processed. The vertex e is the only vertex which is adjacent to the vertex b. 
processed state. So, no venex will be pushed onto the stack Now, the stack 5 .5 fW- 
and no vertex is left unprocessed, we will stop the process here 



Stack 


Visited d, c, e, a, b 

The vertices are traversed in the following order: 

d c e a b 
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Graph 


Search Algorithm 


j Of U*r 

'Ail be used to find the connected components of the graph. It can be 

# tfrft S6^ ch L maze (complicated network of paths). To find the bridges of a graph 

^?sr^-« DFS ” y ““ d - 
*^ 1(V ofDFS 

r (Up 1 ** 1 ™ * . .laorithm, all the nodes and edges are required to be traversed just 

1 ^rh-firs 1 scarCh first search algorithm. Therefore, complexity of depth-first 
U» ^ of breadth- ^ brea dth-first search. That is, if the branching factor of 

* * h dgorithm is same is then the space complexity is the number of 

is b and dept o(b d ). When the number of vertices and edges m the 

S'?*. -P- level Wh 'l space complexity can also be expressed as 0( | £ I + 

£« »” “CSS 5V-1 r I a - — ■* ■— 1 ‘ ■*• 

|f|)where | & I 


8.5 AppUcatiOnS of the science . Three very 

, Finding the reachability 

. Finding the shortest path 

• Spanning Trees 

. plications one by one. 

Let’s discuss above three appn 


teachability hether a particular verte ^ Reachability 

lity, as the word is 

* voices of the g*Pj£ sted in finding fmd ^ reachability m 

his means, we are inte tw0 ways to 

ch vertex of the graph. 


• Matrix Multiplication Method 

• WarshalTs Algorithm 
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^Simplifie d Approach to Data Structures 

8.5.1.1 Matrix Multiplication Method 


C insider a digraph G and its adjacency matrix A which are shown i « 

« own ln figuri 



c 


a 

b 

c 


a 

0 

0 

1 


dLi 


b 

1 

0 

1 

0 


c 

0 

1 

0 

0 


4 

1 

1 

1 

0 


J^n-zero entry m the adjacency matrix for a pair of vertices inH^ * L 
direct path between them without any intermediate vertex uZ ^ *** «a 

vertices is one. Consider the powers of adjacency matrix A J^ lcngthbctWc ^tbc 
shown below: J y ™ x A of foe graph G which j. 


A 2 = 


b 
0 
1 
1 

d[ 0 1 


a 

b 


c 

1 

0 

1 

0 


d 

1 

1 

2 

1. 


A 3 = 


a 

b 

c 

d 


a 

2 

1 

3 

Ll 


b 

2 

2 

2 

0 


c 

0 

1 

1 

1 


d 

21 

3 

3 

1. 


A A = 


\2 

4 

4 

.2 


bed 

2 2 4 

2 2 4 
4 2 6 
2 0 2 . 


from the vcfcxV^tov In^e^ ** ^ ves ^ number of paths of length 

are two pathTof ten^hl f ^ in figUrC <an observe thatto 

is 2. Here, the two paths of len^ two 

^IHere 1 **^ 1 f° m Vertex e to vertex b Hence, entry a 3 (3,2)m« 

seen here, the'second pathT^-i^b i^ot "*7 ” 4 “d C " b " C 

the method of matrix multtpUcafion does noSm^plT “ ^ 

“♦(3,2) V inmanix^ 1 ^ 4 ^* ° f length four cach 60111 vertex «to vertex b. Hence.ent 

P^'^SMt^xveed V"” P .!? digraph Wlth n “odes, the length of an element* 

path from 1 B .r h ' f ° re ’ ‘ f We « interested in finding whether there e*f 
or equal to“ -Tr„ ,L tha * is "fl-** » to exaLe the paths less 

nath nra --... e cafie ’ w bere the source vertex »nH th* rUati nation vertex 
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L® length 4 between any vertices v t an d v/rh^T'" 

* P°** r ° ftbC adjSC<nCy ma ‘ nX 4 ^ the g^ph " ° rei - «*** 
another matrix B n which is defined as 

w c: , 

A + A 2 + * + .+ 

a - n is *e number of nodes in the dtgraph having adjacent 

^*eo^y o fthe ™ mx 8 g, " es ““ fo^ »u«ber of ££%££***■ the 

^’Lween the vertices v, and v,. Now, let us find the mato » 7 th “ ot 

“« for ^ graph shown 


B a bew een 
* figure above 

, + a 2 + a 3 + a* 

i, 

5 3 8 

5 4 9 

8 4 12 

3 1 4 


04 * 


From the graph, we can observe that there are five paths of length less than or equal to 4 
from the vertex a to vertex b. Hence, the entry b (li2) in the matrix B 4 is 5. 

The element of the I th row and j th column in the matrix B n shows the total number of 
paths of length 4 or less which originates from the vertex v ( and terminates at the 
vertex Vj. If any (ij)th entry in the matrix B n is non-zero then it indicates that vertex 
V) is reachable from the vertex V t . Therefore, in order to determine the reachability to a 
vertex from any other vertex, we need to know the existence of the path between them 
rather than the total number of paths between them. 

Path matrix for a Graph 

Consider a directed graph G of order n having set of vertices V c 
path matrix P ofthe graph G will be a n x n matrix whose entries 

( 1 if there exist atleast one path from v, to V) 

■j ^ = ( 0 if there does not exist any path from v t ^ 

u « the existence or absence 

'significance of finding the path matrix is that, its ° w hCi if the «#>' 

the pair of vertices. In the path 
^ing to any pair of vertices is non-zero then tt repress 
'^between them. . ^ i, derived 

^ matrix can be very easily obtained from the £ corresp ond f g 0 ^ ^ 
^wetion fo r a grap h 6, by simply putting ^ ^ p if »,i 

x is non-zero, otherwise put Pij ~~ 
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A Simplified Approach to Data Structure** 

fl 1 1 1 


ll 1 1 1 

The method of finding the path matrix for a graph by using the powers 0 f 
matrix and then calculating the matrix B„ is very burdensome. This method 
the path matrix is even not efficient because it involves the multiplication 
multiplication is very expensive operation. There is another efficient way f or 
path matrix for a graph which we will discuss in the next section. K lr '^ ^ 




8.5.1.2 Warshall's Algorithm for finding the Path Matrix 0 f 
Graph * 


Warshall’s Algorithm is used to compute the existence of paths within a directed 
using boolean operators and matrices. Starting with creating an adjacency matrix A f 0 , 
graph G, if there is an edge between the two vertices, enter a corresponding 1 in matrix 4 
and enter 0 if no edge exists. The significance of adjacency matrix A is that it tells ^ 
whether or not there is a path p of length 1 between two nodes. 


Based on the adjacency matrix of a graph, we will define n boolean 
matrices A 1 , A 2 , A 3 .. A n , where n is the degree of the digraph as follows: 

Let af j denotes the (l,j)th entry of the matrix A k Then 


1 


«£/ = < 


lo 


ij mere exists a simple path from vertex v ( to Vj whlc 
does not use any other vertex as Intermediate point 
except possibly the vertex v k 

if there is no path between n vertices v* to Vj 




J b 

a b c <> e - 


t a 

~0 0 1 o 0 


b 

0 0 0 1 0 


A - c 

0 1 0 o 1 


d 

0 1 o o • 


* 

.1 0 o o 0 J 


A Directed Graph with its Adjacency 


Matrix 'A' 
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we will create a new matrix A 1 f '- -Gr aph 

Wh ‘ Ch W '" aC ' “ an i ^rt n X«e W ni Ch T ** - 

K t0 a ifv we will choose vertex a as pivot f or A i £ P ° mt bet ^een tW’oJT 

£-5U- Followmg rule w,u be used for 

a,jfot 

if there exists a direct path between ventces v t 
is a path which does not use any other vertex except 


: 

Hi J 


i in wil^" we uuy umer vertex py ro ^ 

pivot vertex {for this matrix pivot vertex isa) 0 ^ ^ 

if there is no path between vertices v t to Vj 

■ ize that all paths of length l between vertices v, and Vj are already entered in 
FilA f C y matnx A In matnx A 1 , we search for any paths of length 2 which uses 
^ ^ an intermediate point. The only way vertex a can act as an intermediate point 
'^ath already lies between some vertex v t and a, and between a and vertex Vj. 


a 

b 

A l = c 
d 
e 


rO 

0 

0 

0 

Ll 


b 

0 

0 

1 

1 

0 


c 

1 

0 

0 

0 

1 


d 

0 

1 

0 

0 

0 


e 

Oi 

0 

1 

0 

0 


. . .i • n i This is because there exists a path 

The only entry which is changed m matnx ^ Notice m in the matnx A, the 

between vertex e to vertex c via the pivo • ^ indicates that there is no 

entries a e a and a a c both are 1 but the entry a«> t ^ there exists an indirect 

direct path between the vertices e and c. The en ry e .c 
path between them via vertex a. 

Next, matrix A 2 will be calculated using vertex b as the p 


a 

b 

d 
e 


a 

0 

0 

0 

0 

1 


b 

0 

0 

1 

1 

0 


c 

1 

0 

0 

0 

1 


d 

0 

1 

1 

1 

0 


e 
Oi 
0 
1 
0 
OJ 


“t 1 U IP I This is bec ause lSts 3 pall) 

k W Which “* chan S ed in matriX ^ ^ nt vertex b Similar^ 

!)_ 'tween vertex c to vertex d via the P 1V u Notice that" 1 ^41 t)> el * ' 0 
d to vertex d v.a the pivot 

«C*W a , 4 both are 1 but the entry a c .a indl rect t‘ 

' PJth between the vertices c and d but then exists 


by CamScanner 














A -amplified A pproach to Data Structures^ 

pivot vertex b. Therefore, entry a\ 4 is set as 1. Similarly, the entry a \ 4 ^ ^ ^ 


via 


Next matrix 


A’wiU be created using vertex c as the pivot vertex. 


a 


a 

b 



d 

e 


r° 

0 

0 

0 


b c d e 
1111 
0 0 10 
10 11 
10 10 
1 1 1 1 J 


The entries which are changed in matrix A 3 are a£ b , aj >e , aj 6 , a 3 df a 3 u , ^ 
entries are set to 1 because there exists an indirect path between the correspond- 
vertices via the pivot vertex c. Notice that in the matrix A*, the entry a^ c and Abbott 
are 1 but the entry a\ b is 0 which indicates that there is no direct path between the 
vertices a and b. The entry a^ b is set as 1 as there exists an indirect path between thee 
via vertex c. Similarly, the entries a 3 ad , a\ „ a] b , a\ d , a 3 e are set to 1. 


Next matrix A 4 will be created using vertex d as the pivot vertex. 


a 

b 

A* = c 
d 
e 


b 

1 

1 

1 

1 

1 


c 

1 

0 

0 

0 

1 


d 

1 

1 

1 

1 

1 


e 

li 

0 

1 

0 

V 


The only entry which is changed in matrix A 4 is a bb . This is because there exists a 
between vertex b to vertex b via the pivot vertex d. Notice that in the matrix 4 3 & 
entries a b d and a 3 db both are 1 but the entry a\ b is 0 which indicates that there is * 

direct path between the vertices b and b. The entry ai b is set as 1 as there exists* 
indirect path between them via vertex d. 

vertex.* 0 fmd tHe matriXi4$ ’ We wi " P roceed « before by taking the vertex * as P»* 



a 
ari 


4 s = 


ell 


b 

1 

1 

1 

1 

1 


c d 
1 1 
0 l 
1 1 
0 1 
1 1 


e 

li 

0 

1 

0 

1-1 



cfni iwu uy udm csuari ncr 









n , , , ,, , 



/"Scales that mere is no mrect path between the -— aph 

V#** i as there exists an indirect path between them v.v! “ mia 

entx ' s " 

^ ^matrix wUl be: 


entry 

*• S'tiiUriy, a* 


a 

b 

r* c d 


rl 
0 
1 
0 
eh 


1 

1 

1 

1 

1 


c 

1 

0 

1 

0 

1 


d e 


1 

1 

1 

1 

1 


li 

0 

1 

0 

1 


i. peaking, if a graph has n vertices, it will require n matrices to produce A n = 

Pis the path matrix. 
p where r 

^rithm* Finding the path matrix for a graph 'G' using Warshall’s Algorithm. 

\ l Repeat Step 2 For i = lton 

Zl- Repeat For j = 1 to n 
' set p [<][/] = 

[End Loop] 

[End Loop] 

Step 3: Repeat Steps 4 and 5 For k = lton 
Step 4: Repeat Step 5 For i = 1 to n 

[End Loop] 

[End Loop] 

[End Loop] 

Step 6: Exit 


^litudon: as the adjacency ■Mh'x A of 

*tep 1 and step 2, a matrix P is formed wh'ch'^ n w ws ^for 

having n vertices. The loop ih s e P ^ \ and the 1°°P * ^ patency 

2»*». fc n i.«* »*••*** 


p m step i » * • ^ loop •“ , |acenc y 

—6 w, uic a rows in the adjacency W w ^ column* 

^“8 the n column in the every row c ^ ^ imp 

^ 3 . fcere is a loop for ttansformtog**^^ and ^^hro^ 

■SlShrou "u 4 '. Val , ueofk = l) **JjTjSdtimetfork^^' 

pivot vertex . For the seeing—.. 
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A Simplified Approach to Data Structures 



pivot vertex are checked. In the same manner, the matrix P is transff 

entering the indirect paths through vertex V\ or iy or iy or. 

After the execution of the algorithm, the matrix P generated by it lh a 
which the entry P u = 1, shows the presence of direct or indirect path ^ 
vertices v t and ly On the other hand, P ( j = 0 indicates the absence of an y . ^ 
indirect) between the two vertices V( and iy 


l» 

*** 


8.5.2 Shortest Path Problems 

Finding the shortest path is one of the basic problems '•ncountered in n r 
applications. The length of a path in the weighted graph is defined as the j ^ 

weights of all the edges in that path. Generally, there can exist more than ^ 

between a particular pair of vertices say v t and iy The shortest path between a ’ 

set of vertices may not be unique i.e. there may be more than one paths havin' ~ 
minimum length Consider a weighted graph G having 5 nodes as shown below * ^ 



A Weighted Graph with 5 Vertices 

It can be noticed easily that there exists more than one path from vertex b to vertex 
c which are: 


b -* a -» c 
b -» d -* c 


Length = 5+ 12= 17 
Length - 11 + 5= 16 
b -* a -* d -* c Length = 5 + 9 + 5 = 19 

“ path betWeen the vertex 6 and c IS * - d - C which baP* 

eq to 16, which is minimum among the all other possible paths. 

JeaficaUonff ° f the shorte6t P ath P roblam which vary 

soS of co rlnT Ce "* the de8tinati °» vertex of a path Here, we are V 
<ne ot the commonly used variants of shortest path problems. 
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S**.** I-*** be f0Und *»» ■ Particular sour -- 

' S,«n» ,ionVa, ‘ X - Vtrt « 

softest path can be found between all p 0SS iKi ' Ubr 

• jssr 1 - “•—■— 

shortest path can be found from one particular 

* yjiiices. This problem is known with the name of staeT'’' ‘° a " the »*« 

problem. *“ *' , " rce honest p„ h 

j, aU Pair Shortest Path (Warshall's Algorithm) 

* Arx a weighed directed graph G having 5 vertices as shown in a a 

C !rh is represented by its weight matrix W given below. The entnesTnThe 
^ u, f or any graph G are set by the following rule: th eighl 

matrix n 

the weight of the edge starting from vertex v t and ending at vertex v 
s | 0, if there is no edge starting from vertex v t and ending at vertex v, 


*U 


a 

a r0 


b 

W = c 
d 


5 

0 

0 

■0 


b 

7 
0 
9 
0 

8 


c 

12 

0 

0 

5 

8 


d 

9 

11 

0 

0 


e 

Oi 

0 

7 

0 

CM 


0 CM 

By applying the modified Warshall’s algorithm we will obtain the matrices S, S\ S 2 , 
5 3 , S 4 , and S 5 . To find the matrix 5 replace all those entries of W which are 0 with 
infinity, which shows that there is no edge between the correspon mg vei *| 66 ®’ 
entries are taken as 0 because the path from a node to itself is of zero lengt 





a 

b 

c 

d 

e 

a 

rO 

7 

12 

9 

00‘ 

b 

5 

0 

oo 

11 

00 

c 

oo 

9 

0 

00 

7 

d 

00 

oo 

5 

0 

00 

e 

oo 

8 

8 

00 

oJ 


* S\ andS 5 whose entries will 

of 


k 011,316(1 ^ing the following rule: ^ ^ §um of lengths 

V smaller of the length of path from vertex v, to vert “ ” 

* ^ vertex v, ,o vertex v k and from vertex v* to vertex v,. 

precise ly. rule for defining Sy is as follows. 
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A Simplified Approach to Data Structures 

Stj = Smaller of( Sfj 1 , if*' 1 + S{j‘) 

Now, we will create matrix S 1 using the matrix 5 and following the above stat ed 



a 

b 

c 

d 

e 

a 

r° 

7 

12 

9 

00' 

b 

5 

0 

17 

11 

00 

c 

00 

9 

0 

00 

7 

d 

00 

00 

5 

0 

00 

e 

-00 

8 

8 

00 

QJ 


The entries that are changed in matrix S 1 is Sj c . This is because, there exists a 
between vertex b to vertex c via the vertex a. Notice that in the matrix S the ^ 
Si c - 17 in the matrix 5 1 because there is an indirect path from vertex b to vertex c ^ 
vertex a. That is, S bc = S b a + S ax 

i.e. the entry 5j c = 17 as$J c = S b>a + S ax 

Similarly, other matrices S 2 , S 3 , S 4 , and 5 s can be computed by following the abo * 
stated procedure. The matrices are shown below: 



The matrix S 2 will be formed as, 



a 

b 

c 

d 

e 

a 

0 

7 

12 

9 

00' 

b 

5 

0 

17 

11 

00 

S 2 — c 

14 

9 

0 

20 

7 

d 

00 

00 

5 

0 

00 

e 

Ll3 

8 

8 

19 

0- 

s la = 14 ass 2 ca 

SS 


S b,a 



*ld = 20 as s] 4 = s' cb + sl d 
s* A = 13 as sl„ = s‘ t + *J 0 
s ld = 19 as s] 4 = + s J d 

The matrix S 3 will be formed as: 



a 

b 

c 

d 

e 

a 

0 

7 

12 

9 

19i 

b 

5 

0 

17 

11 

24 

c 

14 

9 

0 

20 

7 

d 

19 

14 

5 

0 

12 

e 

1-13 

8 

8 

19 

0 J 
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Path 
sntry 
c via 


3ove 


At* 


as si. - 4c + 


s 


c,e 

2 


„**!.-**.+ s » 

; sl ,«ssL= & + *» 
s J4 05 sib ~ s *‘ + Sf b 

3 „ \l aSS 3 d ,e s S d,c + 4e 




The matrix 


S 4 will be formed as: 


a 

•0 7 

12 

9 19- 

b 

5 0 

16 

11 23 

S* sC 

14 9 

0 

20 7 

d 

19 14 

5 

0 12 

e 

13 8 

8 

19 0 -1 

v© 

rH 

II 

ll 

3 

4,d 

+ 4,c 

Wt 

Cr*. 

** 

II 

K3 

U) 

as si e = 

s\,d 

+ 4,e 

The matrix S ! 

5 will be formed as: 


a b 

c 

d e 

a 

0 7 

12 

9 19- 

b 

5 0 

16 

11 23 

s 5 s£ 

14 9 

0 

20 7 

d 

19 14 

5 

0 12 

e 

L13 8 

8 

19 OJ 


to matrix S> is the shortest path matrix. Values in this matrix are shortest paths 
toween the respective nodes. 

%rlthm: Finding the shortest paths between the all pairs of 
“ ,iB tW»rsh*Us’s Algorithm. 

Repeat Step 2 For ( = 1 ton 

Repeat For) = lton 

If W [(][/] = 0 And t * I Then 

$[<][/] = « 
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A Simplified Approach to Data Structures 

Else 

sim = mm 

[End If] 

[End Loop] 

[End Loop] 

Step 3: Repeat Steps 4 and 5 For k = 1 ton // V j a nQ ^ 

Step 4: Repeat Step 5 For l = 1 to n // row no. 

Step 5: Repeat For j = 1 ton "columnno. 

Sim = Minimum of (S[i]{J], $[<][*] + 

[End Loop] 

[End Loop] 

[End Loop] 

Step 6: Exit. 

Explanation: "" 

In step 1 and step 2, a matrix 5 is formed from the weight matrix W of graph G having n 
nodes. While forming the matrix S, all the zero non-diagonal entries in the matrix V/ are 
replaced with oo in the matrix S and all other entries are copied as it is. 

In the steps 3, there is a loop for transforming the matrix S for n times. When this loop 
executes for the first time (For k = 1), the new indirect paths through the pivot vertex Vi 
are checked and compared with the existing paths. If there exists an indirect path 5y 
between the pair of vertices Vj and Vj, whose length is smaller than the last known path 
then value of shorter path is entered into the matrix 5. For the second time (k=2), new 
shorter paths through the pivot vertex v 2 are checked and compared with the last kno^ 
paths. In the same way, matrix S is transformed n times for entering the shorter indirev 
paths through the vertex v t or v 2 or v 3 ... v n 

After the execution of the algorithm, the matrix 5 generated by it is a shortest path 
in which the entry Sy gives the length of shortest available path between the p^ Ll 
vertices and Vj. ^ 



Complexity Analysis of Warshall’s Algorithm 

fwhlch aig0rithn ? is 311 P air shortest path problem, all the po-** 

The algorithm comDme^f" 1 ^ vertlces ) between the pair of vertices are 

between the two vertices The pai ^ of vertices > the minimum distance am° * 

es. Therefore - running time complexity is 0(M )• 

>1 
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^^J^urce Shortest Path (Dijkstra’s Algorithm) 

^ d mos t often used application of graph is finding the shortest path. 
uj n thrr. is an application of finding the shortest path from a given source 

-v ^ i a ,‘^ e olne r vertices of the graph. This type of shortest path is known as single 
to ai ‘ pat h Dnkstra's algonthm is a greedy algorithm whose essential feature 
* ub ich the paths are determined. The paths are discovered in the order of 
i to ^,ed lengths, starting with the shortest one and proceeding to the longest. 

■ algonthm is almost identical to Pnm's algorithm. Starting from a specific 
Pijirtrt s IS , gorthm moves outward within the graph until all the vertices have 
'<**• ft Cr D ,,kstra's algonthm is different from Prim’s algorithm in the sense of 
W Le”f distance at each vertex. Pnm's algorithm stores a minimum cos. edge where as 
Sn’s algonthm stores the total cos. from the source vertex to cunent vertex. 

Let us explain the Dijkstta’s algonthm 

.,*1 with each vertex. The label repressMs the dtsta ( ^ permanent Temporary 

as particular vertex. We use two kin s o ^ permanent label is used for 

Ubelfr used for the vertices that are not wtedirt™? is known. The value to 
that ate reached and thett distance from vertex The 

these labels is the distance (cost) of that m not yet reacbed/visited _ 

temporals label may change as conespondtng v ^ ^ repres ,, nt teBjoneyW^ 
as the values in permanent label* can vertex will have temporary a 
cede and permanent labels as squam with four vertices, 

label but not both. Cons.det the following grp 

( Rl 



^ ihe graph (Here, starting from d). 

„ by minaunog a vertex vertices are given temporan’ 

Dijkstra’s algonthm 5ta , be i to * ''J^e 

We give the pennan'”!. ^ here m fig 
labels with costs 00 aS 
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In next step, select the least cost edge connecting a vertex with a pemtanemUM 
in next step,» , b , Here t h e vertex B >s label will change from tempo* 

to permanent' The value of B’t label will be add.tton of the cost of the edge 

vertex A’s label value. 



Next step is to find the least cast edge starting from any ot the penr * f J 
vertices. Here, we find the least cost edge of temporary vertex. eu. 
vertex B The least cost edge here is AC We change the C s lap-. - F* 
value will be addition of the cost of edge AC and the vertex A's \ alue. 















t( w a n the vertices of the graph are reached and the value in each label gives the 
sanest distance from the source vertex A. 


Dijkstra’s Algorithm 

Dijkstra’s algorithm can be explained by using the following notations: 

6 - Connected graph in which the shortest path from a particular source node is 
required. 

-> Initial beginning node i.e. source node. 


1 f -* Set of nodes in graph G 
J Set of all the nodes with permanent status. 

V -> Number of nodes in the graph G 
D -»Set of distances of all the nodes from the source n. d o 

C -»Set of Edges in the graph G other ver tt C es using 

Algorithm: To find the shortest path from a source ve 
Mjkstra’s Algorithm. 


5 *Pl: S = {v 0 } 

ite P 2: Repeat Step For l — 1 ton 


//Direct edges from 0 


Step 3 ; 
Step 4 ; 


added to D 

D[i] = C[v 0 ,i] 
[End Loop] 

Repeat Step 4 to 6 For i 
Choose a node j in 


= l ton - 1 

y — S such that D\j\ 


is minimum 
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.urn r rr - hPatastructu — 

Add J to S 

Repeat Step For each vertex k in V - S 

D[k ] = Min(D[k], D[/l + CUM 

[End Loop] 

TEnd Loop] 


Step 5: 
Step 6: 



Explanation: 

Step 1 is used for init.al.zing the array 5 such that the initial node v 0 is made permanen, 
In step 2, all the direct edges from initial node *. to all the nodes of graph are added w 


array D. 

Step 3 is repeated for n - 1 times i.e., for all the n - 1 temporary nodes. 

Step 4 and 5 are used to select a temporary node (say j) from V - S (total Temporary 
nodes) whose distance from source node v 0 is minimum (i.e. D[j] is minimum) Tins 
selected node j is put into array S i.e., node j is made permanent. 

Step 6 is used to update the distances of all the temporary nodes from the source node. 

Let us take an example to clarify the Dijkstra algorithm. Suppose the following connected 
graph G. 



We take the initial node s from where all the shortest distances to other nodes arf ^ ^ 

suppose, D is an array containing distances of all the nodes from source node > 5 
rray oi nodes with permanent status. 


> we make the source node s as permanent and the distances of all 
or via permanent nodes are put into array D as shown below: 



nodes 




W VMI I I I W VI J V VI ■ ■ ■ V/ V VI ■ ■■ IN/I 














s 

J*i« 


a 

3 . 


b 


c 

x, 


d 

x, 


€ 

*>} 
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s a b c d e 

D m {0, 3, 2, 8, 4, 9} 

S = {s, b, a} 

Next, we choose the node d and make it permanent as its distance from source node s is 
minimum. Distances of all the other temporary nodes in D is updated (calculate the 
distances of all the temporary nodes from starting node s via other permanent nodes i 



2, 8, 4, 7} 


D = {0, 3, 

S - {s, b, a, d} 

Next, we make the node e as permanent as its distance from source node s o 
an update the distances of other remaining temporary nodes (calculate the 
e temporary nodes from starting node s via other permanent nodes)- 
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t 


a 


b c a 

. 2- *■ * V 

»•/» y ^ 

W ‘ ^ ~ vie choos* the last temporary node to make it permanent. 

kfcUstsep* wc 



f ll ,he nodes from the source node. 

Hm, the final array D gives the shortest distances of 

Spanning Tree ^ ^ (r>ph 

* can be defined as undirected, acyclic 

? connecting each pair of vertices. vertices of gr a P h ’ 

^ tree of a connected graph 6 is a tree ^ ^'c'as a ' f ^ing 

S define a spanning tree of a connected graph have many s P 

C 8 the vertices and is a tree. A connected grap. 

0r example, consider a graph G as shown c o 
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The spanning trees (four in number) of the above graph will bet 

©-© ©-(b) © © 


© 


■© @ 


© 4 > 




-d> 



If we consider a weighted graph then a minimum spanning tree may be defined 
spanning tree with minimum weight. Here, the weight of the tree is sum of weight of. 
edges. Consider a weighted graph as shown below: 




■<§> 


© 


<£> 


The spanning trees of the above graph will be: 

2 - ~ 2 


©■ 


"© (a) 


© ® 


®-j—© © 0 

The minimum spanning tree will be: 

© 


-© 


& 


The weight of minimum spanning tree is 7. 


<S) 


© ®——® 


®—r-© ®— 
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u m spwui'ng tree (MST) has various importam apnheat,,,^---~ - 

ThC "“"isT is » sed ,n thC dCS ' gn ° f '' etWork For sample u, ' “ m '°' ,hcm 

* kt L*»l» wh0 “* se P“ ra,ed b y wybg distances, Un’h ZT* * of 
"’trras Of cost. MST does not do anything with the distances but it iw c,,lclcnt ‘y 

u «* because MST does no ' have any cycle and *■ 

w cigW- 

msT is used to find the atrlme routes. The vertices of the graph represent the ones 

* an d the edges represent the routes between the cities. MST will optimize the route 
between different cities by finding the least cost paths with no cycles. 

Another application of MST is to solve the travelling salesman problem. A 

* convenient way of defining this problem is to find the shortest path that visits each 
point at least once. 

' w the problem is, how to find the MST? There are many methods of finding the MST. 

Jo famous algorithms are: 

• Kruskal Algorithm 

• Prim’s Algorithm 

Both of the above methods differ in methodology but ends up with same MSTKruska! s 
algorithm uses edges and Prim’s algorithm uses vertex conneettons to find . 

8.5.3.1 Prim's Algorithm 

Prim’s algorithm starts by choosing an arbitral y vertex will be added to 

node is then considered as the root of the tree. ea ^ ^ a dded to the tree, 

the tree. This algorithm stops when all the no es r . the exeC ution of Prim’s 

The nodes of MST spans at the rate of one no e a a . notations, 

algorithm. To understand the Prim’s algorithm, we us 

^ he the set of selected nodes to form the MST. 
w he the set of selected edges to form the MST. 

S >* Hie set of graph edges. prim’s algorithm step by step «> 

Consider the following graph on which we will apP > 
the MST. 
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Set of Selected Edges M = (<$>} 

Set of Graph Edges 5 * /flA, be, cd, de, ef, fg, gh, ha, ac, bk, gd, ip, 

3 2 1 6 3 2 10 1 6 2 4 i 

Starjng * itfa the node a, we choose a least cost edge which start from node a and does 
not form the cycle. Here, we use edge ah. 

? a edge ah to list M and node h to list N (a was initially in N) and remove the edge 
a/i from 5 

Af * {a, h} 

M = {aAj 

5 - {ab, be, cd, de, ef, fg, gh, ac, bh, gd, dfi 

3 2 1 6 3 2 10 6 2 4 3 

bed 
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N = [a, h, b, c } 

if - f/ift hh he) 



Scanned by CamScanner 












a., mpl if,ed Approach to Data Structures 

Now, the least cost edge cd ts chosen from 5 as it starts from 

form any cycle. 

N = {a, h. b, c, d } 

M = (ah, bh, be, cd) 

S - fob, de, ef, fg, gb, «c> *4 d fl 

) 6 3 2 10 i * 3 


a vertex in n ^ 



Now, we choose the least cost edge df from 5 as it starts from any of the vertices H and 
does not form any cycle. 


N 

M 

S 


~ [a, h, b, c, d, f } 

= {ah, bh, be, cd, df} 

fab, de, ef, fg, gh, ac, gd} 

3 6 3 2 10 6 4 
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the least cost 

** cb °° S fl nv cycle* 

V" 0 k 6, «. d - ^ B) 

»" a V bc ' cd ' d/ ' /ff) 

r<?’ f 1 >° 6 4 


an V °1 lit® vertices m A/ 



/ —M—^ 


any of the vertices in N 

» = {«. *■ b ’ c - d ‘ ]’ fj "L e f\ 

« = (a/i, «i, be. « d - d ^’ f9 n 


S - (ab, it, glh ac < gJ! 

* £ in 6 4 



The Resulting MS1 
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k zntT ✓ ' f i — 

-- „ . MV , . „ ltM wr, »* V * MVI '* »« , 

’ resulting - weight U%* thin i 4 >. 

v/r .r u no Other " 


*ted ••?■— > — 



Step 2 


Step 3 
Step 4 
Step 5 
Step 6 


v not t ft 


Initially * ' V J 

Ui M be the vet of elected edge* m wce 
Initially M - i 
Le*. 5 be vie set of grapk ^3** 

laniatoe with the initial vertex Starting node) 

Repeat While |*| * » //Vo " * ' 

Let (u, v ) be the least cost edge in 5 such that u 6 N dND 

//1 e rte edge (u, vj *>« no/ create an/ cyc/e 

If there is no such edge Then 

Goto Step 10 
[End If, 

Add the node v to N 

Add Edge ( u vj to M and Set 5 * 5 - fu, r) 

'End Loop] 

If Af| = n Then //No. of nodes in N are equation 

Prmt M contains the edges of MST : 

Exit 

Else 


Step 7 


Step ? 
Step 9 


Step 10 


Pnnt:" Graph is not connected and hence no MST can oe forr..^ 

[End If] 


Step 1 i. Exit 


8.5J.2 Kruskal’j Algorithm , 

As already stated that Kruskal’s algorithm is different from Prim’s aigwy 
terms of edges As instead of using nodes-vertices as m Pnms “8° ‘ J l rl pfcC* ! 
algorithm uses edges to form the MST. In this algorithm, all the edges ;cs -** 

ordered in increasing order of their weight. Then at each step. we ^ 
to make MST so that it joins the two partial trees together. If aduing^' 
cycle, rt is rejected as m this case; both the nodes of the edge are alre 
MST formed 
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Structures 



1„ step. <•* eJ * e ce ,S Ch ° Sen 8S 

rSKT* - *■ a<,) 

[ab. ce) 


M 



In 3 rd step, edge bf is chosen to form MST 
as shown, 

S = [cf, ef, ae, bd, ad) 

M — ce, bf } 
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Algorithm: To find the MST using Kruskal’s algorithm 

Step 1: Let M be the set of selected edges that will make the MST. 

Initially M = {(p } 

Step 2 Let 5 be the set graph edges. 

Remaining Edges are Null in S or No. of Edges in M are n - \ 
Step 3: Repeat while S * (p AND \M\ * n - 1 

a. Let (uv) be the least cost edge in 5 

b. Set 5 = 5 - {uv} // Delete the edge {uv} from S 

c. If {uv} does not create cycle in M 

Put the edge {uv} into M 
[End If] 

[End Loop] 

Step 4: If |M| = n — 1 Then //M contains n - 1 edges 

Print: “M is the MST" 

Else 

Pnnt: “Graph is not connected and hence no MST can be fonned 
[End If] 

Step 5: Exit 
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'rL. e e and outdegree ofnodes e and g? 
a'bai« the md ,n the graph are sink and source? 

J Skb of.be the vertices a and e? 

\Vbat are '^Hamiltonian path? 
j - multigraph? If yes, why- 

< &*?*£--«** 

Ware the different methods otg P 

Traverse the following graph by using t 



a. Depth-first search 

b. Breadth-first search ^ 

find the adjacency matrix of graph G sho^o 


previous Examinations) 
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Wied 


"1 


A Sim 

b. Source and Sink 
c Hamiltonian Path 
j Sub giaph 


3. 

4. 


5. 

6 . 

7. 

8 . 

9. 


a g****, Wars hall's algorithm of finding the shortest path ba** „ 


nodes. , . . 

write an algorithm to determine if the graph ,s connected. 

Write an algorithm to check if the graph has a cycle. 

What* a graph? Discuss the main applications of graphs. How ts a graph ^, 

Explain with a suitable example Dijkstra shortest path algonthm for graphs 
What is an adjacency matrix? 

Differentiate between DFS and BFS graph traversal algorithms 
Write short notes on applications ot Graphs. 

Define a directed graph.. 


10. H. What is the difference between graph and tree? 

11 14. Explain the various graph representation methods. List merit* anu dements 

each. 


12. What is a degree of graph? 

13. What is the data structure used for depth-first search 0 

14. What is a weighted graph? What do you mean by graph? How a graph is dnwf- 
from a tree? Discuss various ways to represent a graph in memory. 

15. Write a short note on multigraph. 


16. What are different types of graph algorithms 0 Write an algorithm to tmd 
path for a directed graph. 


17. Define the following: 
a. Path matrix 
b Strongly Connected Graph 

c. Weight matrix 

d. Multigraph 

e. Adjacency List 


(Multiple Choice Questions) 

1 In a graph if e=[u, v]. Then u and v are called 
A endpoints of e 
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Jghbors 

C n f of above 

O' * , without any cycles is called 

•ted g ra P l 


:- 4 f^ee g«ph 

B free tree 


f a tree 

n All of above 


• /11 means 

3. to a %acent to v but v is not adjacent to u 


A. 


B . e begins at u and ends at 


B c "processor and vis successor 

4. If every node u in u n> ^ j 

A. isolated 

B. complete 

C. finite 

D. strongly connected 


5. Acyclic graph has: 

A. a shape like a unicycfe to edges 

B. a graph that cycles from 

c a cycle of two or more nodes 

D. a cycle of three or more nod ^ ^ # 

6. A(n)_-— -~z T 

connection to every othei xtl 
A. directed 


graph 


in 


which 


each vertex has a 


B. cyclic 

C. acyclic 

D. None 


we 


nK> ve 


• a pad, from each veoe—h« 

if there is a pa 

7. A directed graph is . 

vertex in the digraph. 

A. Weakly connected 

B. Strongly Connected 

C. Tightly Connected descend^ 

D. Linearly Connected f a vertex > »• 

8. In the. traverse, we process . 

to an adjacent vertex. 

A. Depth-First 

B. Breadth-First 

C. With First 
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v 0 


U) 


of 


nt 


st 





graph is a graph in which each vertex has a 


■ m a onph if e= f u ' v) me ^ ns 
3 -~ u l5 adjacent to v but v is not adjacent to u 

n e begins at u and ends at v 

q u is processor and v is successor 

0. both b and c 

4 if every node u in G is adjacent to every' other node v in G, A graph is said to be 

A. isolated 

B. complete 

C. finite 

D. strongly connected 

5. A cyclic graph has: 

A. a shape like a unicycle 

B. a graph that cycles from vertices to edges 

C. a cycle of two or more nodes 

D. a cycle of three or more nodes 

6. A(n)_ 

connection to every other vertex. 

A. directed 
B cyclic 
C. acyclic 

D- None tn eV erv other 

* directed graph is.if there ,s a path from each vert 

,ertex ' n the digraph. 

^ Weakly connected 

• Strongly Connected 

• Tightly Connected . ^ ein ove 

• Linearly Connected , descendants be,ore 

fc..traversal we process all of a vertex 

^iwent vertex. 

°epth-First 
. ^ re adth-First 
With First 


B. 

C. 
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D Depth Limited 

’■ ■“ - - r “• " 

,, r.p>——~ **• tat 

m A „ b „ M „ I* c-pl« »“ “ ”** Mm ‘ 


A. True. False. True 

B. True. True. False 

C. True. True, True 

D. False. True, True 


10. State True or False. 

i, An undirected graph which contains no cycles is called forest, 
ii) A graph is said to be complete if there is an edge between every pan ofverte. 


A. True, True 

B. False, True 

C. False. False 

D. True, False 


• c Aao r>a i| j=»h And line segments called arcs or 

11. A graph is a collection of nodes, called . 

.that connect pair of nodes. 

A. vertices, edges 

B. edges, vertices 

C. vertices, paths 

D. graph node, edges 


12 . a .is a graph that has weights of costs associated with its e ges. 

A. Network 

B. Weighted graph 

C. Both A and B 

D. None A and B 

13. Which of the following is an advantage of adjacency list representatio 

adjacency matrix representation of a graph? 

A. In adjacency list representation, space is saved for sparse graphs. r matn \ 

B. Adding a vertex in adjacency list representation is easier than a J ac 
representation. 

C. Both of above 

D. None ^ tfcf 

14. Let G be an undirected connected graph with distinct edge weight 0 f s. » 

edge with maximum weight and etnin the edge with minimum weig 11 
following statements is false? 

:annea Dy uamc>canner 






emin 


<!rtCS 20001 snanmn g tree ofG must contain .— 
f Even mmimU "L.n im um spanning tree, then its removal must disconnect G 

sp»nmg tree conmnsemax 

C r°has aurad 1 * minimum spanning tree 

D ^directed graph with n nodes, there can be maximum of-edges 

fntn-Dfl 

g n(n-l» 

C. 


, IZ—<r n TT' y anbecoasmcud °" oU 

V,.V.» of n vertices 7 

A. n(n-l)/2 

B. 2” 

D - 2 .. , I,, a breadth-first traversal of G k 

p Consider an undirected unweighted graph ^Le a ofthe shonest paths 

donfstarting from a node r. Let ^before v dunng the bread*-nrst 

^erLd which 1 of tteSwmg statements is correct’ cs J001) 

A. dir, u)< d(r, v) 

B. dir, u) > dir, v) 

C, dir, u) <= d (r, v) flh . nodes in 

D, None of the above tMuence of the degrees 

18. The degree sequence of a sim^graph is ^ seque „ces cannot be ~ - 

the graph in decreasing order, 
sequence of any graph? 


II. 

ra. 

iv. 


7 , 6 , 5 , 4 , 4 , 3 . 2,1 

6 , 6 , 6 .«. 3 , 3 , 2,2 
7 6 , 6 , 4 , 4 , 3 , 2 , i 

8 , 7 , 7 , 6 . 4 , 2 , 1,1 


A. I and U 

B. Ill and IV 

C. IV only 

D. II and IV 
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Chapter 9: Sortin 


8 Tec hni ques 


p j introduction 

the data is one of the most common tasks in busmen a > 

S*8» ritbms “ff "T ! n a Set aCCOrdln 8 t0 a pred e n„ed P ord eSSm8 appl ' cat '°« 

^Ijnon w« s of data wh,ch we con « across during data d 8 cr,teri °n The 
ordering relation for numeric data simpt i„ V0 ? e ? Sm8 aM 

lence either from smallest to largest or from largest to smalles i e dZ*'"* m 
pending order respectively. ’ - e - either ascending or 

Consider some items in a set arranged in increasing (ascending a a 
{8,10,12.16.20}. The same items in a set arranged in decreasing (descending "v 
1,(20,16,12,10,8}. Similarly, for the set 7?,*;" 
5= [Ajitesh.Amit, Dlnesh, Lalit, Naveen, Pawan), is in ascending order andc- 
(Pawan, Naveen , Lalit, Dinesh, Amit, Ajitesh } is in descending order. ~ 

Hiere are numerous algorithms available for sorting the data. But, none of them is best for 
all applications. Performance of the algorithms depend on various different factors some 
ofimportant factors are listed below: 

• The type and amount of data to be sorted. 

• Amount of the memory space required by the sorting algorithm. 

' Characteristics of the data to be sorted, whether data is in random order, partially 

sorted order, or in reverse order. 

The complexity of the sorting algorithm and the ease with which it can be 

lm piemented. 

Whether the internal sorting technique is required or external sorting technique is 
required depending upon whether the whole data to be sorted can be brought into 
he Random Access Memory (RAM) or not respectively. 

^amount of data to be sorted, the sorting techniques can be divided into 'u 

‘ nten »l Sotting 
Ext emal sorting 


Scanned by CamScanner 



A Simplified Approach to Data Structures 

9.2 Internal Sorting 

In internal sorting techniques, the sorting process takes place entirely within th 
memory of a computer. Internal sorting can be used only if data to be sorted ,7 
enough that can be accommodated in the main memory. Some of the commonly^ 11 
internal sorting techniques are discussed in this subsection. * 

9.2.1 Selection Sort 

Selection sort is the sorting algorithm which is in-place comparison sort. Here, the t er 
in-place means that this algorithm does not use any extra space for sorting the elements^ 
the array. That is, the same array is used for sorting the elements of the array. Selection 
son is stable as it does not exchange the relative position of elements with equal value 

The idea behind the selection sort is to find the smallest element in the array and replace it 
with the element at the first position in the array. Then, find the next smallest element of 
the array by starting the search from the 2 nd position to the last position of the array and 
replace it with the element at the 2 nd position in the array. This process is continued till the 
entire array is sorted. 

Consider the unsorted arrav A of size 8 shown below: 


A[l] 

A [2] 

A [3] 

A [4] 

A [5] 

A [6] 

A[7] 

m 

22 

35 

17 

8 

13 

44 

5 

28 

l“Pass 








Search tor the smallest element from A[l] to 4 [8]. Here, the smallest element is 5 whicl 
present at position ot the array A Exchange the values at ^4f 1] and A\1 ] which resi 
in the array shown below: 

A[l] 

A [2] 

A [3] 

A [4] 

A [5] 

A [6] 

A [7] 

A[8) 

L_lJ 

1 35 1 

17 

8 

13 

44 

22 

28 


2 nd Pass 


The resulting array after completion of the 1st pass 


whid, iT Ch t0r the J raalleSt element from A[ 2 ] to /t[8]. Here, the smallest element is] 
result XT a ' k P °T" of the arra y A - Exchange the values at A{ 2 ) and AH] ** 

results in the array shown below: 
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Sorting Techniques 


smallest element from A|3| to /t[8] Here, the smallest element 13 

,arch f° r thC S |rt the array A. Exchange the values at /If3] and A |5] which results in 

so*- position in ine d " 


M4) 

A[5) 

A[6) 

A[7] 

A[8j 

! 35 

17 

44 

22 

28 


jt < ,p pos 

below: 

aI 21 AfM 
13 

The resulting array aftor completion of the 3rd pass 

id pa$$ _ 

h for the smallest element from 4|4] to M|8|. Here, the smallest element is 7 
»‘ c nut V‘ position m array A Exchange *e values at 4[4| ami A{ 5] which resu s 

anay shown below:. A(g) 





5 th Pass 


rei aifll Here the smallest element is 

Now. search for the smallest element J^j a l A y A . 4[7] which results in 

present at f position in the.ay4. Exchange 

the array shown below: A mi A[ 6 J A W 



—- rr 1V after completion 

The resulting array 31 


6 Pass 

Now, search for the smallest e' Exc hang L 
present at 8 lh position m 1 ie 
the array shown below: AL 4 J 

AW AW 


of the 5th pass. 

Here, the smallest element is 28 


■lenient from “Ji"! at h|6]'a‘nd A|8] which results in 



-^-^|,l„mofthe«hpass. 

. 

, |eS , element from.i» ">“<** 

ch for «*!%** after 7'" pass will be as shown below 


7 th Pass 

Now, search ^he array 

present at 7 ^ take I 
no exchange 
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“t 


Vi. iOfCh 


.w r. - - 

in the anayA- E i.tor^ — ' ' 

*my shown below 

ty| A[ 2 J A$ >i 4 ; - - 


- " > c e c-«acni is -~ 


_ • _, r ^ jf '" results in 


i7 


* 'fc 
-1* 1 


5 

ft# 

b 


S 


n 


22 


rt 




1 


The mailing 4n* < '>• • *: ' '«rv , .'Z,'S*. 




•^beksw- 


*?t '/je c " > /: 2>. 

4' *, fcr 2 ' jsfc ' tv J 4 •: n 





















Sorting Techniques 



smallest element from A[3] to 4[ 8 ]. Here, the sma 
** \ n th e array A. Exchange the values at A[3] and A[5] 


jVy tOt u * v 

^ - i*nosmontn inc 


smallest dement 13 
which results in 


, t fpos 

belov*' 





The resulting array after completion of the 3rd pass. 


‘* P,SS . . sm e i emen , from A[4] to A[8] Here, the smallest element is 17 

*>*■ search 1ior , n ^ amy A Exchange the values at A[4] and A[5] which resu is 

->tesent a* - 

;he arra> shown below.. A|6| A(7) m 



The resulting array 


after completion of the 4th pass. 


54 Pass . rc1 x roi Here the smallest element is 22 

Sow, search for the smallest element tom A [5^ U ^ ^ and m whlch result, in 
present at 7 th position in the array A. Exchange 

the arrav shown below. ^1 A[7] -M8) 

ACll A121 A[31 AW Al5) 



The resulting array 


after completion of the 5th pass. 


6 th Pass r . . rftl uere the smallest element is 28 

Now, search for the smalles. alii at A W and A W which resulls m 

present at 8 * position in the arrayA. Exchang 

the array shown below. A16J A ' ' — 

k[\\ A121 A l 31 1 


28 


55 


44 


The resulting arra - 

7 th Pass , A[1] to A(8l. Here, the sma ‘ l ' St s f^this case 

Now, search for the smaUest element . g dy at its Proper pos^^ 

^Sr^^after^passwaibeas 


present 
no exchange 


381 
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13 




44 


Step 2 
Step 3 
Step 4 


J--—r after completion of the 7th pass. 

The resulting array arcer cu t r 

Thus, the above arra> e , emen ts using the Selection sort tech„| que 

Algorithm: Sorts an array A w * ^ 

Stepl Repeal Steps 2 to 5 For 1 1 T ° ” 

** se, Mir, - 41] And «»» * f «'» 

Repeat Step 4 For j = ' + 1 To n 
If A{j] < Win Then 

Set Min = 4[/] 

Set Pos = j And Flag = True 

[End If] 

[End Loop] 

If Flag = True Then 
Set Temp = A[i] 

Set j4[i] = A[Pos] 

Set A[Pos] = Temp 
[End If] 

[End Loop] 
itep 6: Exit 


Step 5: 



Explanation: 

In this algorithm, step I is used to repeat the loop for n " 1 _ pa j’.^ '| e0i nti» 
index 1 to n - 1. In step 2, the i th element of the array is assumed the sma ^ 
Min variable and a variable Flag is set to False . This variable wil e 
assumed value of Min is smallest. The value of Flaa will become True 
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^——-— - Sorting Te chniques 

A1 * orl,hm - 

* ng, ' S nc an array using the selection sort, it takes n - 1 passes to sort the whole 
' V. The l" pass takes (n - 1) comparisons to place the smallest element at 
array ot sl itl0n , 2 nd pass takes (n - 2) comparisons to place the second smallest element 
*&■*«*, position, 3 rd pass requires (n - 3) comparisons to place the third smallest 
J( the seC e position and so on. In the last pass, there will be only one comparison 
gleinent a j ast ^ w0 elements simultaneously. Therefore, total number comparisons 

:^ana,ayof„z e nwiHbe, 

^ s (n - 1) + (n - 2) + (n - 3) + .+ 3 + 2 + 1 


= n x 


* 0(n 2 ) 

Selection sort has same complexity in best case, average cue, as _well as worst case. Thts 
,s because; the number of comparisons will remain same (n x —J to find the stna est 

"tlmtfrlrortedVTof the array a, the proper postrton ,n sorted part o, 

the array. 

9.2.2 Insertion sort fficjent for smaM collection of data. 

Insert,on sort is a stra.ght forward method**!^ techraque . Thts algorithm »•£ 

Insertion sort is also an in-place comp* '™ as it recetves .he 

known as online sorting method becaos starts getting 'he e sort stable 

means, i, starts sorttng the elemen s as soon as^ ^ ~ sot, 

require inputting the whole listof el S“^f,he elements wtth equal value 

as it does not change the relative pos.u ^ dements by inserting one element 

The idea behind this sorting Hsttoto the soned pan of ' he Mrls 

each time from the unsorte part ^ is constdered » be whlch has 

Initially, the whole list is i.«* W* 1 * 

sorted part having only one ^ lj# u comp ared with the 

res,of n - 1 elements. ^ appropnate posttton ,nrhe sotted 

In each successive step, 1 e p he list an a h dements ot the Its. are sorter 
elements in the sorted pari * iv e steps. 


part of the list. Aftern- laU j ; e8 sh own belo- 

Constder an unsorted 

Afll Af2 ]_ 8 1 1 ■ ■ — 

11 -- 1 Ife^ments is divided into two parts t e the sorted 


28 


M 


22 

1 -^ 

Initially, conS ‘ 


whole list ot 


383 
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Now. starting from the first element of the unsorted part, we mil insert elements^ 
one into the sorted part. Here, the first element d[2] (- 35) of the unsorted 
compared with the element A[l) (= 22) m the sorted part of the list As A[2] > ^ 

element A[2] will remain at its position as shown below. 

Am Af21 A[31 A[4] A[5] A[6] A[7] 


1 22 1 

1 35 1 

Ljlj 

8 

13 

1 44 1 



.now. me !>uricu pan ui 

unsorted part of the list. 


i the 


Now. comparing element A[3] (= 17), the first element of the unsorted part of the list, 
with the elements of the sorted part of the list i.e. A[2] (= 35) and 4[1] (= 22;, the 
element 4 [3] will be inserted at the 1 st position of the list as shown below: 


A[1] 

A[2] 

A[3j 

A [4] 

A[5] 

A [6] 

A[7] 

A[8) 

17 

22 

35 

8 

13 

44 

5 

28 


Now. the sorted part of the list has 3 elements and remaining 5 elements are present in the 
unsorted part of the list. 


Now. it s the turn for the element A [4] (= 8), which will be compared with the elements 
in sorted part of the list until an element smaller than A [4] is found. As the elements 
/4[3](= 35), A[2}(= 22), and A[l](= 17) are greater than A[4[(= 8), so, elements 
i4[3], A[2], and 4[1] will be shifted one position towards right and the element 4(4]*® 
be inserted at position .4[1] as shown below: 


A[1] 


A [2] 


A [3] 


17 


22 



A[4] 

ST 


A [5] 


A [6] 


13 


44 


Now. the sorted part of the list has 4 sorted elements and 
m the unsorted part of the list. ™ S and 


remaining 4 elements are 



elements 4[2] anTU^ ^ mserte d at position A[2) a^ r s 

A[ll 1 1 ° ne P0S,,i0n t0WardS “ sh0 ™ i" bel °" : 


13 


A [6] 


----I_ J “ 35 I 44 5 

In the next step, element A[61 -- 1 - 1 -- 

e emem a s compared to the element m f ln at same position because it 

e ments in the sorted part of the list. 


28 
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.I’ 

API 

A[4] 

AR 

A(6] 

111 

A [7] 

icciiniqui 

AW 

at;-—— 

^ 0/00000 ^\ * *4 

^ I I 

8 1 

L 17 -L 

22 

35 

44 


J 28 

;T ._ ; 

5) will be inserted at position A [1 ] as shown below 


Mil W 

API 

AW 

A[5] 

A[6] 

A[7] 

A[8J 


i r 

17 

22 

35 

|~ 44 

1 28 

--— 

rhe hnal step, the element A[ 8](= 
5 oned hst will be 

: 28) will be inserted at position A [6] and the resulting 

All] A[2] 

API 

A[4] 

A[5] 

API 

A[7] 

m 

M 1 

"rn - 

17 

22 

28 

35 

44 


Thus, the given anay has been sorted 

Algorithm: Sorts an array 'A' with n elements using the Insertion sort technique. 


Step 1: Repeat Steps ^ to i For i = 2 ton 
Step 2: Set Temp = A[i] And k - i - 1 

Step 3: Repeat While Temp < A[k ] AND k> 0 

Set A[k -t-1] = A[k] 

Set k = k - 1 
[End Loop] 

Step 4: Set A[k + 1] = Temp 

[End Loop] 

Step 5 : Exit 


V\ 


Explanation: 

-tl . . . # ov(afMlte the loop from index 2 ton. The loop is executed from index 

The step 1 ,s used to 1 ^ soned pan of ^ „ st and a „ 

‘•because the element at nde. ^ g . ^ Hs , We ^ required , 0 ^ 

n - 1 elements in , h e unsorted pan of the list into the soned pan of the 

ements ftom index 2 ofthe unsorted pan of array is taken into the variable Temp 

nd 1" S< l P , ininahTed to i - 1 (*• -dex of the las. element of die soned pan of the 

Usn iTnen t loop is executed till the i"> element gels us accurate position in the sorted 

nan of the list In this loop- '' ele J" ent ' em P' ' s compared with the elements in the 
soned of the array starting from las. index ot soned pan of die anay. 

If the Temp variable is smaller than the compared element ofthe sorted part ofthe arras, 
s shtfted ... one position nght. It the Temp tar,able becomes larger or equal to the 
M 1 Mto Q- > .orttftl pun p. die array, tnc Temp t .M. .. ..,... 
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A Approac h to D^a Struct^ 

Analysis of Insertion Sort Algori 



Analysis oi ..— . . L , 

fnr this sorting technique is, when elements of the list an* • 

Th . e 'Tthe'desired one. In the worst case, each element from unsoned part ® jj* hv, y 
^ combed with all the elements of the sorted pan of the list. Thus, i„ , hls ^ ^ 

tn nn5ition the 2nd element of the list at proper position No. of comparisons = \ _ 

0 DO on the 3rd element of the list at proper position No. of comparisons 
to posiuu alompnf of the list at proper position, No. of comparison 


1 


to position ine ora cicuiciiw 

to Dosition the 4th element of the list 


to position the nth element of the list at proper position, No. of comparisons = 

So, the total number of comparisons in the worst case, 

f(n) = i + 2 + 3 + 4 + 5 + 6...+ (n-2) -f (n-1) 

(n - 1) 

= n x - 

« 0(n 2 ) 


Thus, for the worst case, the complexity of the insertion sort is 0(n 2 ) 

The best case for this sorting algorithm is, when the data elements are already sorted For 
such case, the insertion sort runs in linear time 0(h) because during each iteration, ti 
element from unsorted part of the list is inserted into the sorted part of the list with cr¬ 
one comparison. So, total comparisons to sort n elements will be n-1. 

Thus, for best case, the complexity of insertion sort will be 0(h). However, for the 
average case, the complexity will be 0(n 2 ). 

9.2.3 Merge Sort 

Merge sort is one of the sorting techniques which is based on the divide and conqu c 
strategy to sort any unsorted list of elements. Like the previously discussed Quick* 
technique, the Merge Sort reiterates on the list of elements by dividing it into sn* ' 

thTfomul^ SOrtm8 6aCh SUb POrti ° n ' ThC Merge Sort divides P artitions in half b> ^ 


• inucA • 


Mid = , ~ L0Wer • ) , 

2 ere, lower is the lower index and upper is the upper 

half and conthiufnTth” 1 ” 3 ' 68 ° n ^° th 01 **’ e new ly formed partitions by dividm, 
reaches oneTm 8 Pr ° CeSS ' Th ' S pr0Cess ““on ,he ^ 

sorted orter The ne S xt C T ,ed T" 5, one ' item lists. By definition, any one-tte® f 
for creaiing the sorted hs? “ S ° ning pr0Cess is one-,ten. I- » 
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echniqi 

l ists ’ the Mer & e Sort compares successive pairs of elements,'one 
lv coflW 6 { If the list A has any element smaller than all the elements of list B, then it 
join & c \ ’ sen to be appended to the aggregate list and vice versa. And when all the 
*iH t* cil0 f one ii s t has been added to the aggregate list, the remaining elements of the 
elefl* 0 ^| 0 wil j be appended to the aggregate list directly. While this merging algorithm 
ano^ er ^ S w jth two sorted input lists of unequal size in order to minimize the number of 
will vl, ’ or r0U tine. Merge Sort tries to combine lists with the equal (or nearly equal) 
call 5 to lements This merging process takes at least (n/2)comparisons but not more 

Hi® (# " l)compansons. 

Sort repeats the process of combining sorted sublists into larger sorted sublists until 
y Sle been successfully integrated into a single sorted list. To understand the working of 
a . vterce Sort algorithm, consider an unsorted array A of size 8 as shown below: 

ami Aren AK1 Af7l Af8] 


41 


35 



13 


Algorithm s .ans w,,h splitting array A into .wo sub-arrays 41:4 and A[ ft8] of - four 

each as shown below: 

A[l] A [2] 


41 


35 



MW ’ " 1 ■'*- - “ 9VS Afl: 21 and A{3: 4] of size two each as 

„ t , a [ a . ai cnlit into two arrays 

Now the sub-array A[l. 4J is spin u 

shown below: Ar ci a[6] A[7] 

A[4] -- I , | T 

44 I ^ 1 


A [2] 


A [3] 


28 


41 I » I 1] and A[2:2], because these two 

-'- in a S ° rted SUb ' array A[h SlZe 

Now, the merging P roce5;, her s ub-di v,<le 

sub-arrays can not be tu a(6) A[7J A M 

two as shown below: f A(4] 


A(l] A [21 


A Pi 




——-T^it into sub-arrays of size one each and 
L ^- i —****** 9oned arra> m 4101 wc ! " 1 

this stage array c 
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c^lifled Appw^hJoPSgJSiSSag 


Next, the sub-arrays 
of size 4 which is shown below: 

All] A[2) A[J] 


,s A[ 1:2] and A[3:4] are merged to produce a sorted sub-array 



Now the pending task of sorting the unsorted sub-array 4 [5:8] will be resumed as«< 
Sine and sorting the sub-array 4 [1:4] is over. We are showing the steps for spl lttm 
and merging on sub-array 4[5:8] directly without explatmng the steps. 



The heart of the Merge-sort algorithm is conquer step, which merges two sorted 
into a single sorted sequence as shown in figure. 
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l: 4] 


^ Of 
ing 


AP) 

A[4] 

A[5] 

A[6] 

A{7] 

A [8] 

13 | 

17 

28 

35 

41 

44 



Following Merge Sort algorithm sorts an unsorted list of elements ustng recurs,on and 

function MergeListsQ. 

„ axi . i/i us ine an auxiliary array o . 

Algorithm: Sorts an array A[L.U J us g 

MergeSorting (Lower, Upper ) 

Step 1: If Upper > Lower Then 

Set Mid = (low'*'' + Uppe ’ ' 

Call MergeLists(Low 

[End If] 

Return . e j e sorted list. 

Algorithm: Merges two sorted sub-Hsts tnt 

MergeLists(Lower,Mld, Vppe ^ ^ + t 

Step 1: Set IM = = UpP er ' 

Set Uhl =«' d ' 1 "’ 2 ' 

Seth = 1 hl < vblANDLb' 1 < 

Step 2: 

Step 3 : 

389 


Step 2: 
Step 3: 
Step 4: 
Step 5: 

Step 6: 
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Set 161 - Lbl + 1 
Set * = * + 1 


Set B[k] = A[Lb2] 
Set Lb2 = Lb2 + 1 
Set k = * + 1 


[End If] 

[End Loop] 

Step 4: If 161 > Wl Then 

While Lbl < Vbl 

Set B[k] = M bb2 ] 
Set Lbl = Lb2 + 1 
Set k = k + 1 
[End Loop] 

Else 

While IM < Ubl 

Set B[k] = -4 [161] 
Set 161 = 161 + 1 
Set k = k + 1 


[End Loop] 

[End If] 

Step 5: Repeat For k = Lower to Upper 
Set A[k] = *[Ic] 

[End Loop] 

Step 6: Return 

Explanation: 


The merge sort algorithm is divided into two functions. The first function 
MergeSorting () which takes two arguments Loiver(represent the lower index of arra) 
or subarray) and Upper (represent the upper index of array or subarray) This function is 
called recursively, each time halving the size of the array until the subarrays have the size 
of one element each. Each time subarray is divided into two subarrays of size 1 each, 
MergeListsO function is called. This function is used to merge the sorted subatrays. 

™ S f r C !'Ll a teft^ee S ari.men e ts S / COnd which is ‘he heart of ,h,s 

This algorithm takes tnree arguments Lowerirenresmt tk 0 1 • , r cnharrav)> 

Upper represent the upper index of the ? ■££*<* 

lower and upper)._ ay) ' and ^(represent the mid value 











Sorting Technique 


♦non. the step i is used to initialize the variables, The variables 161 and 

U». *• iiiwl imhur r\C th. SI _« 1 


ltoK hze d with lower index and uppei index ol the lint aubarray to be merged 
„»! *«. Lb i and Ub2 M' initialized with the lower index and upper index of the 
(K '^haray to be merged. A variable k is initialized to I which is used as index for 
^•oid g m w |nch sorted elements will be copied. 

used for executing the loop. The loop is executed till one of the two Itsti is 
vs ithtn the loop in step 3, the element present at index Lb 1 is compared with 
^.resent at index Lbl. It A[Lbl] is less than or equal to A\Lbl\, then the element 

f lbi is copied 10 array B at indcx k Atter coping A \ Lb ^ at both thc variable8 

Jd k are incremented. If A[Lbl] > A[Lb2]thcn Lbl and k are incremented. 


Lb land 

The step 3 is executed until Lbl < Ub 1 AND Lbl < Ubl i.e. we reach the step 4 when 
of the two subltsts is finished. In this step, we check whether the first list is finished 
• Lbl > Ubl) or second list is finished {Lbl > Ubl). If first list is finished then the 
elements of second list are directly copied one by one to the array B using a while loop. 
Bsc if second list is finished then thc elements of first list arc directly copied one by one 
to the array B using a while loop. The step 6 is used to print the sorted elements of t ic 

array B from Lower to Upper. 

Analysis of Merge Sort Algorithm 

As illustrated in the example discussed above, meige sort consists P d [ n t h e 

the data elements being sorted. In the first pass, sub- 1 , ts of«« «« « “ £ sub .„ sts 

second pass, the size of the sub-lists being mcl ^ * ws wjH bc performed over the 

being merged will be of size 2 • A tola o ' each pass of mer ge sort lakes 

data. Since, two files can be mer8 * d . ' uime complexity is 0 <nlog 2 n). 

0(n) time. As there are lo^ 2 n P asses ' 1 t the sorted 

. , „„ it r ^nuires extra space to store tne soneu 

Merge sort algorithm is not in-place algotium ^ elements do not exchange their 

elements. But this algorithm is stable as the replica 

positions. 
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Exercise 

^ ^Bowing elements using Merge son. 


Sorting Technimi 


i you have read. 


. 7« 18,100. 0. 19 

<5,65. 

the following elements using lnsemon son. 

^ 77,l$» ^ 

tanpire the complexity of all the sorting algorithms; 

. following elements using selection sort. 

,01,105.110.99.200.115.85 
< g^lam the idea behind Radix sort. 

Wnte down the algorithm of merge sort giving example. 

Questions from various U niversities previous Examinations) 

Make a comparative list of limitation* strong points, applications and order o, 

following sorting algorithms: 

a. Quick Sort 

b. Insertion Sort 
c Radix Sort 

d. Exchange Sort 
e Merge Sort 

f. Shell Sort sort? 

2. What is the complexity of bubble sort an at ^ ^ over internal sorting. 

’ ■»«- " ances 

4 a sotting medtod is .table ^ ^ 
sorted sequence as the> 
algorithms are stable 

a. Bubble Sort 

b. Merge Sort 

c. Quick Sort 

d. Exchange Sort rfng. onta ,„j„g 100 eiemenu using 

5. Write a detail note on ' „ ee ded - ^ alre .dy sorted is _• 

6. The number of ^ or igin»> arra> ss it s complexity. 

Selection sort ^ a igorid’ 0 ’ ^ ^ complexity. 

7. Write the sel-- n , h m » using , 

8. Wnte the heap ^ eicmen , s «.'> w 

9. How the f° 110 " 
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* v m • 

Radix sort 



a 


b Quick sort 
c Merge sort 


11 Compare the 


10 Write an alg 


algorithm (non recursive) to implement the quick sort, 
the selection sort and bubble sort algorithms. 


(Multiple Choice Questions) 


1. The complexity of merge sort algorithm is 

a. 0(n) 

b. 0(log n) 

c. 0(n2) 

d. 0(n log n) 


2. Which of the following sorting algorithm is of divide-and-conquer type? 

a. Bubble son 

b. Insertion sort 

c. Quick sort 

d. All of above 

3. In a selection son of n elements, how many times is the swap function called in the 

complete execution of the algorithm? 

a. 1 

b. n - 1 

c. n log n 

d. n2 

4. Selection son and quicksort both fall into the same category of sorting algorithms. What 

is this category? 

a. 0(n log n) sons 

b. Divide-and-conquer sorts 

c. Interchange sorts 

d. Average time is quadratic. 



a. 21 

b. 41 

c. 42 

d. 43 



6. Suppose we are 


sorting an array of eight integers using 


some 
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Sorti ng Techniques 

"four iterationsot the algorithm's main loop, the arrayTIements are 
>Sass r h oWnhere: 

81 - 6 is corr ect? (Note: Our selection sort picks largest items first.) 

;.^ c b statenie rj n 'might be either selection sort or insertion sort. 

Tbe algon V m mlg ht be selection sort, but it is not insertion sort. 

J Tbe algon thffl i S n ot selection sort, but it might be insertion sort. 

£ . The . s neither se iection sort nor insertion sort. 

*rrion sort a good choice for sorting an array? 

* iVben inb nent 0 f the array requires a large amount of memory. 

*• ccomponent of the array requires a small amount of memory. 
b ' nt array has only a few items out of place, 
d The processor speed is fast. 

, Wba, is the worst-case time for merge sort to sort an array of n elements ’ 

a. 0(log n) 

b. CM.n) 

c. O(nlogn) 

d. 0(n2) 

9. What is me worst-case time for quicksort to sort an array of n elemenrs. 

a. 0(log n) 

b. O(n) 

c. 0(n log n) 

10. If we use merge sort to sort 

required for the sort? 

a. 0(1) 

b. 0(log n) 

c. O(n) 

d. 0(n log n) fter ^ese recursive 

e. 0<n2) ... Which statement rs tru 

s * 

t ssiVs 1 """ 

‘ * . sW mregers using qurcksorr. and « 

‘ NO " e 1 e sorr‘ 0 ®. ^n^whh th®' na ^ looking litre this: 

12. Suppose *' flrs'P ar "" 

finished tn 
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2 5 1 7 9121110 

Which statement is correct. 
a The pivot could be either the 7 or the W 

b The pivot could be the 7, but it is not the 9. 

The pivot is not the 7, but it could be the 9. 
d. Neither the 7 nor the 9 is the pivot. 


13 . What is the worst-case time for heapsort to sort an array of n elements? 

a. 0(log n) 

b. O(n) 

c. 0(n log n) 

d. 0(n2) 



14 Suppose, you have an array of n elements, containing only 2 distinct keys, true and 
false. Give an O(n) algorithm to sort the array. 

a. Bucket sort with 2 buckets. 

b. Merge sort 

c. Both 

d. None of these 


15 Suppose we are debugging a quicksort implementation that is supposed to sort an array 
in ascending order. After the first partition step has been completed, the contents of 
the array are in the following order: 

39 1 14 1724 22 20 

Which of the following statements is correct about the partition step? 

a. The pivot could have been either 14 or 17 or 24 

b. The pivot could have been 14, but could not have been 17 

c. The pivot could have been 17, but could not have been 14 

d. Neither 14 nor 17 could have been the pivot 


16. Suppose, we are sorting an array of ten integers using some quadratic Fortin, 
algorithm. After four iterations of the algorithm's main loop, the array element 
ordered as shown here: 1234506789 

a. Which statement is correct? (Note: Our selection sort picks largest items 

b. The algorithm might be either selection sort or insertion sort. 

c. The algorithm might be selection sort, but could not be insertion sort. 

d. The algorithm might be insertion sort, but could not be selection sort. 

e. The algorithm is neither selection sort nor insertion sort. 


17. Which of the following is not the internal sort? 

a. Insertion Sort 

b. Bubble Sort 

c. Merge Sort 

d. Heap Sort 
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Indexed Sequential Search 

There is another technique to improve search efficiency for a sorted file, but it 
involves an increase in the amount of space required. This method is called the in. 
dexed sequential search method. An auxiliary table, called an index , is set aside in 
addition to the sorted file itself. Each element in the index consists of a key kindex 
and a pointer to the record in the file that corresponds to kindex. The elements in the 
index, as well as the elements in the file, must be sorted on the key. If the index is one 
eighth the size of the file, every eighth record of the file is represented in the index. 
This is illustrated by Figure 7.1.1. 

The algorithm used for searching an indexed sequential file is straightforward 
Let r, k, and key be defined as before, let kindex be an array of the keys in the index, 
and let pindex be the array of pointers within the index to the actual records in the file 

We assume that the file is stored as an array, that n is the size of the file, and that indxsze 
is the size of the index. 
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for (i = 0; 7 < indxsize && kindex(i) <= key; i++) 
. » 

lowlim = (f == 0) ? 0 : pindex(i - 1); 
hilim = (f == indxsize) ? n - 1_ : pindex(i) 1. 
for (j = lowlim; j <= hilim && Kj) J ++ 


return ((j > hilim) ? -1 : J)I 

to j •. u the same key, the foregoing algorithm 

°te that in the case of multiple records with ^ ^cord in the table. 

(loes not necessarily return a pointer to the hrst m the items , the table 

The real advantage of the indexed sequen 1 roust be accessed, yetthe 

? "• examined sequentially if all the «c^ * e seque n.i al search ,s pedonned 

oirj? " me for a particular item is sharp y (aWe 0 nce the “J the record 

L the smaller ind ex rather than on the la ^ g f rm ed on a small po 

J f ound a second sequential search is perfor 

* D,e itself 


393 
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. , onniirable to a sorted table stored as a linked li*» 

The use of an index* PP^ ^ * , inked Ust imp i ies a larger space ^. as Wey 

as to one stored as an a y- ,, is can b e performed much more read i* 9 * 1 frr 
pointers, although insertions and deletions ca f ore read,, * 

if the table is so large that even the use of an tnoex ooes not achieve suffix 
efficiency (efther because the index is large in order to reduce sequential searJS 
theiablefor because the index is small so that adjacent keys m the mdex are f % 
each other in the table), a secondary index can be used. The secondary index ach . 
an index to the primary index, which points to entries m the sequential table. njj 

illustrated in Figure 7.1.2. . , ,, , , 

Deletions from an indexed sequential table can be made most easily by fl ag • 

deleted entries. In sequential searching through the table, deleted entries are ig nore i 
Note that if an element is deleted, even if its key is in the index, nothing need be done 
to the index; only the original table entry is flagged. 

Insertion into an indexed sequential table is more difficult, since there may not 
be room between two already existing table entries, thus necessitating a shift in a larog 
number of table elements. However, if a nearby item has been flagged as deleted in th ■ 
table, only a few items need to be shifted and the deleted item can be overwritten. Thj s 
may in turn require alteration of the index if an item pointed to by an index dementis 
shifted. An alternative method is to keep an overflow area at some other location and link 
together any inserted records. However, this would require an extra pointer field in each 
record of the original table. You are asked to explore these possibilities as an exercise 
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U.7 Direct File Organization 

In the sequential file organization discussed in the preceding section, to access any 
articular record, it is necessary to process all its preceding records which is inefficient 
P d undesirable for interactive processing. Another approach which is very efficient for 
the interactive processing is to directly compute the address of the desired record and 
cess it. However, to take the advantage of direct accessing, it is necessary to store 
thefiles on some direct access storage device (DASD) like magnetic disk. 

M techniques have been developed to implement the concept of direct addressing. 
More discussing the direct file organization, it is necessary to spend some time with 
some of the commonly used addressing. 


Addressing Methods 

j • 4-U&. fiiAc the records must be stored &t the 

To facilitate the direct access of the records in ^ predefined taction is 

addresses specified by some predefined to ‘Xiadtotaeachrecordofthefta 
applied to the key field of the record, it £ en ^ ^ physical addresses is calle 

This method of associating keys of re “^^fdto ^nsfo.irithekeyofarecord.nto 

Mapping or Hashing and the function which <s used 
its physical address is known as Hash unc 1 

*»»*■*■•*"*■ 

Consider a file with n records having a se 
such that: 

K ) 

K - (Kv fa' . . " c A f the records with the 

• p the physical addresse ap p r0 ach is that for 
Tie idea of using the keys to deteunm ma j n problem w■ * ’ m not ne unique The 

H of some function is excellent, but ^ mapp jng fan f as collision, where K, 
°me key values, addresses generate y K,and IS , sses generated by so 
slt uation when H( Kl ) = H(Ka) f ? r ^ records whose defined as ta 

f™* *2 are the key values of two * s Co |tj s ion can e ^ same physical # 
function H are H(K t ) and Records atonappc collision reso 

’>nn. when two or more d'^'^'lues, *crc ex.st 
e various address calculation 
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M Approach to uaia - 

-. als0 . Before discussing about the collision resolution techZT^^ 
addressing methods known as hashing techniques. <1Ue *' 

11.7.1 Hashing Techniques 

The idea of calculating the physical addresses of the records by using their k , 

be implemented by using a variety of methods known as hashing technij 
" i •_Hnwever the main aim nf nil t. ,. 


KXvariety of methods known as hashing 
mainly a searching teclinique. However the mam aim of all the hashing &„,%!« 
map a relatively large domain of key values to a relatively small ranged 
Since the key space is usually much larger than that of address space ,**'''«« 
possible that hash function may result in same addresses for different kev v S i 
handle such kind of situations, a collision resolution technique will always b e Tt 
resolve the collisions. So, collision is a condition when two or more keys man 
same location. 

Some of the desired characteristics of any hashing function are its simplicity f 
calculation, and uniform distribution of addresses in the address space. Simplicity 
it is always desired that a hash function should not be too complex. The processing time 
taken by the hash function to compute the address for the record should be minimum. 
Thus the main aim of a hash function is to calculate address for the records very quickly 
with the minimum number of collisions. 


Array of 

Employee Record Object* 


Employee record key 34001 


Key 23761 


Key 92379 


Key 34001 



Let us now discuss some commonly used hashing methods: 

• Mid Square Method 

• Division-Remainder Method 

• Folding Method 

• Shifting Method 

vaX 38MK- .^-address * ra he con veXd ** 

conversion should not lose any infection contained in the W vai ^ 
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^jjMtd-Square Method 

tvinct pntrunAnKf j 


WTrfW value. Usually, me nuib^VZ ta T. W ^ 

**! depends on the address apace on which rl' f ^ picked from the °! the 

<a 4-digit key 5010, the key wTut Wtok emapL 
Cs can be obtained by selecting the approprf^ X nUmber 
f^uare. The number of digits to be picW £?£**<*• *<»»•<* Serf 
U from the number of digits required for the relative^ ° f ““ **“* ustully 
upping of 4-digits keys to 3-digit addresses by ex^n'dt^ ^ Consite »* 
Jit positions 4 to 6 from lower most digit of the number. 8 & ° m thesqaare which 


Key Value 

5010 


Square of key Valu^ p^~^- 

~25100100 1 TZT ~—- 


ollision 



5400 


29160000 


Table showing the relative address for some key values 

11.7.1.2 Division Remainder Method 

The division remainder method of calculating addresses is one of the methods which first 
came into the existence. In this method for mapping key toad,iress the 
a number which is approximately equal to the number o a\ at a 
remainder generated is taken as relative address for the record. 


Key Value P Remainder after dividing the key by 997 

y _ (Relative Address) --- 

1098 ___1 --—“ 

U20 -- 


1230 

1410 

1866 


Collision 


Zollision 


2095 


2117 


Table showing the 


. HrMS for some key values 
relative address w* 
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A Simplified Approach 


to Data Structures 


In division remainder method, selection of appropriate divisor is of crpaf • 
distributing the keys to the address space evenly. Generally, a prime m 
nearly equal to number of available addresses is taken as divisor. mnber whi clj 


11.7.1.3 Folding Method 

In the folding method, a key value is partitioned into parts, each part with 
of digits (equal to the number of digits required for the relative addresses ) ^ nutt >ber 
part. Then, the parts are folded over each other and are added and adjusted** 1 * ^ last 
the final carry to use it as relative address. Consider the example of 8di • ignori og 
51421673 which is required to be mapped to 3-digit address space. In fxJ 8 * ^ Val ue 
will be accomplished as shown below. ln 8 Method it 


*51 


421 


673 



1 5 * 

4 2 i 

3_ 7 6 

* 4 ? 


Illustration of Folding Method 

™?“L“ 3 ' d,glt address generated by the folding method for a record of key value 

51 * 2 lm ' Glven beIow ,s the teble showing the mapping of 8 digit key values cm3 digit 
auQrcss space. 


Key Value 

Relative Address 


10037525 

572 


10988567 

763 


20542270 

634 —-- 



20543170 

634 - 


Collision 

25789444 

^ 753 


3000000 

030 


32450001 

780 


36000625 

156 



Addresses generated by the Folding Method for some key values 
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,4 Shift* 118 Method 

A .« « « • 


**' ’ hift jng method, the digits at both the ends of w 
#«**£»» generate the suitable relative^ ** shifted to an nm • 
of tf®„c added and the result of addition is th2r 1116 di * its Sr 2 numb “ 
^“address range As an example assume an 8-digt ‘^ orin S!^ ca4tom 

fiZ** to 44,8,1 address - In the **«■>« •? 

Z^ 61in 

, digi , number formed by stuffing the 4 leftmost digits inward wil| be ^ 

4 -digit number formed by shifting the 4 rightmost digits inward will be 7312 
No w, these numbers will be added to form the 4-digit address as shown under: 

3536 

7312 

0848 

After ignoring the carry, 4-digit address for key 35367312 will be 0848 

11.7.2 Collision Resolution 

As stated earlier, hashing function maps a large key space to a relatively small address 
snace so there are possibilities that more than one different key value can be mapped to 
the same address. Consider the situation when we want to store a new record with key 
vie K and the address generated by the hash function H(K), is already occupied by 

some other record with the key value K, This situatXionletotaii' 

the colliding record will now be decided by som f h col i is j on resolution 

subsection, we will discuss about the two broad categories ot 

techniques. These techniques are: 


• Open Addressing 

• Chaining 


7.2.1 Open Addressing colliding record’s key u 

his category of resolving the If no such 

'ped to some other vacant address i 0 f record cannot e open 

. the overflow condition occurs and the keyo^ is called probing 

'ess. The different techniques to tim , dressing a re: 

‘essing. Main the techniques ot op 


• Linear Probing 

• Quadratic Probing 

• Double Hashing 
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ii 7 21.1 Linear rruu...* 

1 ^ Wntf if a record with key K is mapped to an address which • 

In case of linear prob f recor d then linear search starting from the addW»L“ 

°?totoTs°donf^til a free location is found for the storage of the new «^ b * 

haS , .. n is always met if it is available. Linear probing alaon* 

A" .^UTn such a way that, starting from the address generated by the tosh fal®* 
implemented m hecke d whether it is empty or not. Once an empty??!?■’ 

s0tus ,l?tS“ fared over there. On the other hand, if the end 
18 ace isTeached without meeting any free location then rather quitting, we start, ££j* 
Ke e^ tanon from the first address of the address space until a free *£* 
enco^S or location having address which was generated by the hash function ? 
encountered again. In the latter case the file is completely fall and there is no sp** * 
accommodate the new record. 

For using linear probing technique the hash function will be: 

ur,ch (K n''! = \H(K) + nlmodm 


Here, H(K) is the hash function used to find the relative address before collision. 
Generally, it is division remainder method. 


So, H{K) = Kmodm 

p is the probe number which can be 0,1,2,.... tit 1, cmd ttt is the size of the hash 
table. 

Consider a hash table of size 10. Suppose we want to insert some records with key values 
33,101,99,83,93. 


Here, the hash function used is taken as 


H(K ) = K mod 10 


For l“ Key, K = 33 

■ 

0 



Hash(K,p ) a* [ H{K ) + p]modm 

i 


1 

Hash (33,0) = (33 mod 10 + 0) mod 10 

= 3 

2 



3 

33 



4 




5 




6 




7 




8 




9 
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1 * . 
ilosh (M) 

„^l l0l0) 


[HW + pj mod m 
[101 mod 10 + o] mod 10 
1 mod 10 


ir 3 rd Key, K = 99 


tsh(K,p) = [H(K) + pi mod 
ish (99,0) = [99 mod 10 + 0] mod 10 
= 9 mod 10 
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to Data Structures 


Hash ( K,p ) 
Hash (83,0) 


» [H(K) + p] mod m 
a* [83 mod 10 + 0] mod 10 
s= 3 mod 10 
= 3 


The record with this key (K = 83) should be at index 3 of 
hash table but this position is already occupied so we 
increase the probe by 1. (i.e. p - 1) and again find the 
address 


Hash ( K.p ) 
Hash (83,1) 


= [H(K) + p] mod m 
= [83 mod 10 + 1] mod 10 
= (3 + 1) mod 10 
= 4 


So, this record with key (K = 83) will be stored at 4 lh 
position of the hash tabic. 


For 5 ,h Key, K = 93 

Hash (K,p) = [//(TO + p)mod 
Hash (93,0) = [93 mod 10 + 0) mod 10 
= 3 mode 10 
= 3 

But the 3 rd position in hash table is occupied so we increase 

the probe by 1. 

//as/i [93,1] = [93 mode 10 + 1] mod 10 
= [3 + 1J mode 10 

= 4 

Again, 4 ,h position in the hash table is occupied, so we 

increase the probe by I. 

Has [93,2] = [93 mod 10 + 2] mod 10 

= [3 + 2] mod 10 

« 5 

TTie record with key [K = 93) is stored at 5* position in 

the hash table. 



101 


3? 




93 


448 

— 
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-- —^^^j^+gatuzation 

^ — ■'Lag any particular record, the same sequence of location is searrh-a v 

O is found or ®?,* mpty 008,101118 encountered - to the latter caseX'Zw 

J^is not presentin the tile. 

72l .2 Quadratic P rob,ng 

^ ' the quadratic probing technique the hash function will be, 

^° U Hash(K,p ) = [H(/f) + C t p + C 2 p 2 ]modm 

af1C\ is the hash function used to find the relative address. Usually the remainder 
HeS ’- H method is used. i.e. 

^fte probe number which can be 0,1,2. m -1 

1 is the size of hash table 
r and C, are constants which are non zero. 

1 (he proper use of quadratic probing, the values of constants C, and C 2 must be 
cCsen appropriately. 

,, „ . , n ouooose we want to insert some records with key values 

-Tit ZZ SS-, a »“ » - *»■ "•— 


For l“ Key, K =33 

Hash (33,0) = [33 mod 10 + 3x0 + 
= 3 mod 10 
= 3 








33 


_ _ 





a 


■i 

J 
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lifted Approach to Data Structures 


For 2M Key, K - 101 

Hash(K,p ) = [H(K) + C x p + C 2 p 2 ]mochn 

- [101 mod 10 + C x x 0 + C 2 x 0 2 ] mod 10 
= l mod 10 



I F or 3 rd Key, K = 93 

Hash (K, p) = [H(K) + C x p + C 2 p 2 ] mod m 
I = [93 mod 10 + C t x 0 + C 2 x 0 2 ] mod 10 

= (3 + 0+0) mod 10 
= 3 

The record with key 93 should be placed at position 3 in Hash 
table but this position is occupied by the other record. So we 
increase the probe by 1 

Hash (93,1) = [93 mod 10 + 3 x 1 + 1 x l 2 ] mod 10 
= [3 + 3 + 1] mod 10 

hashtoble. 0 ^ ^ ( * = 93) wiU be s,ored at add ^ 7 in 



----- -|_ — - mi 

11.7.2.1.3 Double Hashing 

te stored aHte hom! ! Pbro “ h t0 flnd ‘he address of the record when the record cannot 
collision resolution^echnique 3 '^ ^ D ° Ub ' e hashil * * the efficient *«hod of 
address of any key Touwth , because l( uses double hash function to calculat 
any Key. To use the double hashing technique, the hash function will be 
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is the hash function used to find the relative address. Usually it is 
t* 6 '. fa division method. 

^ is second hash function to find the relative address. Let it be also remainder 

HiW method Otherwise, these two hashing functions may be different, 
division men 

>,(*) - K mod m ' 

m i S the size of hash table 

At' i9 less than m 

p U the probe number which can be 0,1,2 .... m 

Consider a hash table of size 10. Suppose we wan. to insen some records with key values 
22,33.93,103 

Here the hash functions are taken as 


H^K) = K mod 10 
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A Sifnplificd Approach to Data_Structurcs 


For 2* Key ,K = 33 




Hash (. K,p ) 
Hash (33,0) 


= [H t (K) + pH 2 (K)]modm 
= [33 mod 10 + 0 x 33 mod 8] mod 10 
=s 3 mod 10 


For 3 rd Key, K - 93 

Hash(K,P ) = [H X (K) + P H 2 (K)] mod m 
Hash (93,0) = [93 mod 10 + 0 x 93 mod 8] mod 10 
= 3 mod 10 


But the 3 d position in the hash table is occupied so we 
increase the probe by 1 

Hash (93,1) = [93 mod 10 + 1 x 93 mod 8] mod 10 
= [3 + 1x5] mod 10 

= 8 

So, the record with key (K = 93) will be stored at location 
8 in the hash table. 
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V = 103 
* ey ’ K 

+ pH 2 (K)]modm 


iiashft'^n-i - ri 03 mod 10 + 0 x 103 mod 8] mod 10 

;> 3 ' o) : u*io 


,d DOS ition is the hash table is occupied so we increase 
BUl,th bebyl 

„ n - [103 mod 10 + 1 x 103 mod 8] mod 10 
Hash v i ’ l) — — 


- (3 + 7) mod 10 


So the record with key (K = 103) will be stored at location 0 
in the hash table. 





Bucket hashing: 

• Bucket hashing is another type of collision resolution technique which is used for storing the colliding 
records/key values together at the same position. 

• It is a different technique in comparison to open addressing. Instead of reassigning the colliding records to 
different address positions in the address space, we store the colliding records together at the same address 
position. 

• This is achieved by using buckets. The bucket is simply a large space used for holding multiple records. The 
address space is divided into multiple buckets. 

• In other words the M addresses of the address space are divided into B buckets. These buckets are further 
divided into slots. The no. of slots per bucket is given by M/B. 

• For example if our Hash Table or address space has 20 addresses which are divided into 5 buckets, then every 
bucket will in turn have 20/5=4 slots as shown in the following figure: 

Hash Table (Address Space) 


20 


Slotl Slot2 Slot3 Slot4 


Bucket 1 
Bucket2 
Bucket3 
Bucket4 
Bucket5 


• These buckets enable us to store the records with key values corresponding to the same address together into 
slots. So basically our hash function will map the key value to the bucket address rather than the home address 
of the Hash Table. 

• Consider if 4 key values Ki, K 2 , K 3 and K 4 , correspond to same bucket address Bi, then these keys are placed 
into the 4 consecutive slots of bucket Bi. 

• If another key K 5 now maps to the bucket Bi, where all 4 slots are filled, then we conclude that the bucket is 
full giving an overflow condition and key K 5 is then added to a separate overflow bucket at the end of the table, 
having an infinite capacity. 

• All buckets share the same overflow bucket. 

• Another variation of bucket hashing is using linear probing to map the colliding key value to another bucket, 
instead of storing it into an overflow bucket, if the home bucket is full. 

• Bucket hashing does not avoid collisions entirely but it helps in minimizing the initial collisions by storing the 
initial colliding records together. 

• A good implementation of bucket hashing requires using an efficient hash function which maps the key values 
appropriately to the various buckets available and reducing the possibility of the key values going to the 
overflow bucket. 

• Let us consider a bucket address space of size 5 with 3 slots each. Suppose we want to insert some records 
with key values 22,101, 33, 93, 103, 203. 

• Also let us assume the Division Remainder hash function to generate the bucket addresses for mapping the 
given key values. 


For 1 st key, K=22, the bucket address generated 


will be: 


H(K) = K mod m 


H(22) = 22 mod 5 


= 2 mod 5 


= 2 
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For 2 nd key, K=101, the bucket address generated 
will be: 

H(K) = K mod m 
H(101) = 101 mod 5 
= 1 mod 5 

= 1 

For 3 rd key, K=33, the bucket address generated 
will be: 

H(K) = K mod m 
H(33) = 33 mod 5 
= 3 mod 5 


For 4 th key, K=93, the bucket address generated 
will be: 

H(K) = K mod m 
H(93) = 93 mod 5 
= 3 mod 5 


For 5 th key, K=103, the bucket address generated 
will be: 

H(K) = K mod m 
H(103) = 103 mod 5 
= 3 mod 5 
= 3 

For 6 th key, K=203, the bucket address generated 
will be: 

H(K) = K mod m 
H(203) = 203 mod 5 
= 3 mod 5 
= 3 

Since Bucket 3 is full now, with all 3 slots filled, key 
K=203 will now be inserted into the separate shared 
overflow bucket. 


Bucket 
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Resolving Hash Clashes by Open Addressing 

Let us consider what would happen if it were desired to enter a new pan num¬ 
ber 0596397 into the table of Figure 7.4.1. Using the hash function key % 1000, 
/i(0596397) = 397; therefore the record for that part belongs in position 397 of the 
array. However, position 397 is already occupied by the record with key 4957397. 
Therefore the record with key 0596397 must be inserted elsewhere in the table. 

The simplest method of resolving hash clashes is to place the record in the next 
available position in the array. In Figure 7.4. 1 , for example, since position 397 is ahead) 
occupied, the record with key 0596397 is placed in location 398, which is still °P en ' 
Once that record has been inserted, another record that hashes to either 397 (such as 

8764397) or 398 (such as 2194398) is inserted at the next available position, w 
is 400. 

Searching **’ 

A 
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(define TABLESIZE... 
tytedef KEYTYPE ... 
typedef RECTYPE ... 
struct record { 


KEYTYPE k; 

RECTYPE r; 

} table[TABLESIZE]; 


We also assume a hash function hikey) and a rehash function 
nullkey is used to indicate an empty record. 


r h(i). The special value 


int search(KEYTYPE key, RECTYPE rec) 

{ 

int i; 

i = h(key); / hash the key 7 
while (table[i].k !- key && tableti).k nullkey) 
i = rh(i); / rehash 'V 
if (tablefi].k nullkey) { 

/* insert the record into the empty position */ 
table[i].k key; 
tabletij.r rec; 

} /* end if V 
return(i); 

} /* end search '/ 


. in kex r r 1000. and rh(i) is the 
In (he example of I tame 7.4.1. Mto’.v' j s ( he next sequential posit'Ci 

unction (i + 1)*? |(KK) (dial is. the rehash a . , rn _ 

nihearrav. except that the rehash ot gg ,! j ' set . if »c can determine t epr 

Let us examine the algorithm more c ^^ our at.ent.on « * ** 
"ies of a “good" rehash function. In ’’V^e efficiency of ,h,: ,7|./cequals key (i„ 
«cause the number of iterations ileten such that 10 . ^ ^ ua | s nullkey 

« ««ed in one of two ways: either. such that 

'Inch case the record is found), or' » , lhe record may ^ are tw0 possible 

ln w hich case an empty position is h™ executes f 01 *' ss jble to ins e,t an ^ 
h may happen, however, that th P |hat it is i P 0 ^ numberof « c “ r a 
«■ forthis Rest, the table may peeping aco™> 0 ^on, are attempted- 
>■ This situation can he detected ^ * „ 0 additional 

le. When the count equals the 4,1 
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However, it is possible for the algorithm to loop indefinitely even if 

* VimnACA rrvt» av** 


mm 


are some (or even many) empty positions Suppose, for example, that 
Ml) = (i + 2) % 1000 is used as a rehash function. Then any key that hashe, 
odd integer rehashes into successive odd integer• «*any.key- that hashes into 
integer rehashes into successive even integers, Consider the situation which 
odd positions of the table are occupied and all the even ones are empty. De spite “* 
fact that half the positions of the array are empty, it is impossible to insert a new 
whose key hashes into an odd integer. Of course, it is unlikely that afi the odd posiC 
are occupied, while none of the even positions are. owever, i t e rehash function 
Mi) = (I + 200) % 1000 is used, each key can be placed in only one of five position, 
[since x % 1000 = (x+1000) % 1000], and it is quite possible for these five places,, 

be full while much of the table is empty. . . 

One property of a good rehash function is that for any index i, the successive 
rehashes rh(i), rh(rh(i)), . .. cover as many of the integers between 0 and tablesize - i 
as possible (ideally, all of them). The rehash function rh(i) = (i + 1) % 1000 has this 
property. In fact, any function rh(i) — ( i + c) /c tablesize, where c is a constant value 
such that c and tablesize are relatively prime (that is, they cannot both be divided evenly 
by a single integer other than 1 ), produces successive values that cover the entire table. 
You are invited to confirm this fact by choosing some examples; the proof is left as an 
exercise. In general, however, there is no reason to choose a value of C other than 1. If 
the hash table is stored in external storage, it is desirable to have successive references 
as close to each other as possible (this minimizes seek delay on disks and may eliminate 
an HO if the two references are on the same page). 

There is another measure of the suitability of a rehash function. Consider 
the case of the linear rehash. Assuming that the hash function produces indices 
that are uniformly distributed over the interval 0 through tablesize - 1 [that is, 
it is equally likely that h(key) is any particular integer in that range], then initially, 
when the entire array is empty, it is equally likely that a random record will be 
placed at any given (empty) position within the array. However, once entries have 
been inserted and several hash clashes have been resolved, this is no longer true. For 
example, in Figure 7.4.1 it is five times as likely for a record to be inserted at position 
994 than at position 401. This is because any record whose key hashes into 990. 
991, 992, 993, or 994 will be placed in 994, whereas only a record whose key hashes 
into 401 will be placed in that location. This phenomenon, where two keys that hash 

into different values compete with each other in successive rehashes, is called pritnory 
clustering. 

The same phenomenon occurs in the case of the rehash function rh(i) = 0 + ^ 

'O tablesize For example, if tablesize = 1000, c = 21, and positions 10, 31, 52,73, 

? , ar ^ a occupied, any record whose key is any one of these five integers will be 

h tpL \ °. catlon 1 ° fact, any rehash f unction that depends solely on the index to 
be rehashed causes primary clustering. 

deDendonZn° f u llm l nating P rimar y clustering is to allow the rehash function to 

this approach thTf ^ °^ t ‘ mes that t * ie function is applied to a particular hash value. * 

TjZt liftheTr t “ a f r i0n 0f tW0 arg — • yields the rehash 

(i+j) % table*™ xk c IS ^ ein ® hashed for the 7 th time. One example is iW>j) 

(1 + 7) % tablesize. The firs, rehash yields rh I = Mh(key).\) = (h(key) + \)%' abl 


Searching 
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size, the second yields rh2 (r ,, 

% tablesize , and so on. K ni + 2) % tabled . 

Another approach i s to lK ’ the third yields rh3 = (rhl + 3) 

and U (where t equals tablesh* 3 rand °m permute- 

and to let the jth rehash of h(kev\ k ’ , the lar gest index°nf°l the , numbers between 1 
(age of ensuring that no two <WV **» table), pl , p2 . 

j s to let the y'th rehash of h(kpv\ k CS ° f tbe same kev nn T hls bas the advan- 
quadratic rehash. Yet anothpr^l^^W + sqrij)) % "® ,ct - Stil > a third approach 
L rehash to depend on ”h7h a T thod of oHminaZ^^f- ™ s is ^ the 

in ‘° Hovrevep although 1 these methixls te | re ^ as *' “ a "° W ^ ““ haS " 

nate another phenomenon, known as second/F^F^™^ c ^ uster ^ n S» they do not elimi- 
hash to the same value follow the same reha h Cl “ sterin 8 ' in which different keys that 
is double hashing , which involves the i . path ' °, ne way t0 eli minate all clustering 
hi, which is known as the primary hash function funct i° ns ’ and h2(key). 

at which the record should be placed If that Dosirin USed l ° determine the P osition 
rh(i kev) = (i + h2(kev)) °/r tnhi • • Position is occupied, the rehash function 

h j * , ^ i}/, tablesi ^ e *s used successively until an empty location is 

found. As long as h2(key\) does not equal h2(key2). records with keys lyl and key! 
do not compete for the same set of locations. This is true despite the possibility that 
h 1 (key 1) may indeed equal hi (key!) . The rehash function depends not only on the in¬ 
dex to be rehashed but also on the original key. Note that the value h2(key) does not 
have to be recomputed for each rehash: it need be computed only once for each key that 
must be rehashed. Optimally, one should choose functions hi and h2 that distribute the 
hashes and rehashes uniformly over the interval 0 to tablesize - 1 and also minimize 
clustering. Such functions are not always easy to find. 

An example of double hashing functions is hl(key) = key % tablesize and 
hl{key) = 1 + key % t, where tablesize is a prime number and t equals tablesize - 1. 
Another example is hi (key) as defined above and h2(key) = 1 + {key!tablesize) % t. 


Deleting Items from a Hash Table 

• • a-cg n fn Hpletp items from a hash table that uses rehashing 
Unfortunately, it is difficult to d _ rd rl is at position p. To add a 

search and insertion. For example, supp inserted j nt0 t he first free position from 

ord r2 whose key k2 hashes into/?, , deleted, so that position p becomes 

ong rh(p), rh(rh(p)), • • • • ^ u P p0S ^ « K eg i n s at position h(k2), which isp. But since 
pty. A subsequent search for reco ma y err oneously conclude that recor / 

t position is now empty, the searc pr „, , 

bsent from the table. mhlem is to mark a deleted r ec0 * a ^. encoun . 

One possible sol “ tion “ t ^ parching whenever number of 

ier than “empty” and to cont ^ js possible only f ^ through the entire 
:d in the course of a search. searc h would requtffe “empty.” Ideally, 

=tions; otherwise, an unsuccessful .searc^ „ de|eted „ rathe r than 

le because most positions wi 473 
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we would prefer a deletion mechanism in which retrieval time is the same whenever 
n records are in the table, regardless of whether the n records are a result of n inser¬ 
tions or w insertions and w — n subsequent deletions. Later in this section we examine 

alternatives to rehashing that allow us to accomplish this. 


Scanned by CamScanner 


